Repository navigation
Conversation
Delta pass over both feature maps to main@3a893a1. - F36: own the memory routes, drive reopen and artifacts/from-conversation, map the projects switch (flag-off, runtime env, tools while off), the failed resolution judge, pull requests (prs), board tags cleared on remove; Gotcha for #7054. - F18: switch every experimental feature, edits to settings.json on disk. - F34: endpoint audit allows the projects client routes. - F19: drop a history reference. - S03: route_task_to_model on a RouterLLM conversation. - S06: the project coordinator and worker prompt presets. - S09: drop a history reference; README maps the project tools and errors.py. - Both baselines move to main@3a893a1. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_013ArwwN5qni9qsqRdGJfiMr
The coordinator can write to project memory on its own during earlier model-backed bullets, so the recipe deletes existing files first. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_013ArwwN5qni9qsqRdGJfiMr
…on the updates Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_013ArwwN5qni9qsqRdGJfiMr
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_013ArwwN5qni9qsqRdGJfiMr
Contributor
REST API breakage checks (OpenAPI) — ✅ PASSEDResult: ✅ PASSED |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
HUMAN:
Engel Nyst (@enyst) set up a daily automation that keeps the verify-agent-server and verify-sdk feature maps current. This PR is its run for main@3a893a1, after PR #7031.
AGENT:
I'm an AI agent helping Engel Nyst (@enyst) with project work.
Why
This is the daily delta pass over both feature maps, at TARGET main@3a893a1b:
Every family that the
ownerscommands listed was replayed live on fresh runs. Every edited family was then re-run by an independent agent. This pass looked closely at the new experimental flags:projects(#6602) andfactories(#7016), plus the flag cache (#6936).This machine has no DeepSeek key, only a LiteLLM proxy serving
deepseek-v4.1-flash. Recipes that read$DEEPSEEK_API_KEYor assert the nativedeepseek/...models fail here for that reason alone. Every family with such fails was re-run through a local stand-in for the DeepSeek API that forwards to the proxy (shimruns below).Summary
Agent-server map: delta pass. The baseline moves to 3a893a1.
ownerscommand listed 34 families: F01–F13, F16–F19, F21–F25, F27, F29–F34 and F36–F40.F33.completion-logs: the stand-in reports the proxy's model name.F34.endpoint-audit: the drift fixed here.F36.resolvednow drivesPOST .../reopen, andF36.artifacts-restdrivesPOST .../artifacts/from-conversation.F36.flag-off(every/api/projectsroute answers 404 at once, and projects come back with no restart),F36.runtime-env(OH_RUNTIME_EXPERIMENTAL_FEATURESwins over the stored switch),F36.flag-off-tools,F36.judge-failed(Projects board: failed judge asks the user, remove clears board tags, coordinator never auto-resolves #7038) andF36.pull-requests(feat(projects): record the pull requests a project member opens #6922, through a stubgh).F36.remove-conversationandF36.wakegained the Projects board: failed judge asks the user, remove clears board tags, coordinator never auto-resolves #7038 checks.F36.auto-resolveandF36.needs-youare now listed as sub-features.F36.memory-restclears memory first, andF36.memory-toolwaits for the coordinator's run before the restart.F36.turnfailing on a 60 s judge timeout through the proxy; it passed on re-run.F18.experimental-switch: all six flags switch, stay on across a restart, and switch off;factoriesadds no tools. NewF18.experimental-file-changes: the Cache experimental flags in the settings store #6936 cache sees edits, corruption and restores on the next request. A Gotcha records the cache's mtime+size limit. The "ask_useris not mapped yet" drift is fixed. Independent re-run: 38/38.ProjectsClientroutes, which are not in the OpenAPI document (include_in_schema=False). Pass.SDK map: delta pass. The baseline moves to 3a893a1.
ownerscommand listed 12 families: S01, S03–S09, S13, S16, S17 and S19.sdk-map report): 274 pass, 26 fail, 1 blocked.Actionmodels droppattern,constandadditionalPropertiesbefore the request #6766, [Bug]: pause()/interrupt() during run() startup is taken for a resume, the agent keeps running #6848, Bug: run_goal returns an unanswered question from an abandoned branch #6907, [Bug]: Soft condensation forgets history when the summarizer returns no text at the output limit #6957, [Bug]: Single-server MCP config advertising a built-in tool name (e.g. 'terminal') crashes conversation initialization #6992, [Bug]: MCPToolObservation.from_call_tool_result drops EmbeddedResource blocks and structured_content #6993, Security: SecretRegistry leaks rotated credentials in cleartext after update_secrets() or LookupSecret re-export (and drops masked history across sub-agents) #7002.deepseek/deepseek-flash. All 9 of its tests pass through the stand-in.live_mcp. This recipe was not edited, and it passed in the shard's run.S03.route-task-to-model: a new bullet and aroute-routerprogram mode for Route task classifier through RouterLLM routes #6943 (route_task_to_modelon aRouterLLMpicks a route and pins it withswitch_routed_llm). Pass.S06.system-prompt-registry: theproject_coordinatorandproject_workerpresets from feat(agent-server): projects API, coordinator tools, board groups and artifacts #6602. Pass.S09.runtime-add-resume: a history reference is dropped. Pass.errors.pyhas a reason not to be mapped.sdk-map ownersreports no unowned paths.Both maps
withheld_tools, and that a member's child has noprojecttag while Projects is off. Main has neither: tools refuse when called, and the child keeps the tag.refuse_pending_confirmationdoes not exist either.message_workerrefuses on its own.check:agent-server-apiandaudit:endpointsall pass.sender_conversation_id) ↔ S04 pass (in-process). The remote SDK path is still [Bug]: RemoteConversation.send_message(sender=...) silently drops the sender that LocalConversation records #7004.projectsoff, a client can add a conversation to a project and setprs/resolved, which become board state once Projects is back on. Reproduced twice by an independent agent. Not a regression; it came with feat(agent-server): projects API, coordinator tools, board groups and artifacts #6602. It needs a product decision: the off behavior is deliberate and tested, but its effect after re-enabling may not be.projectsswitch already, but has no Projects UI yet: feat(projects): OpenHands Projects in Canvas (experimental) OpenHands#19495 (open).factoriessidebar for feat(agent-server): add factories experimental flag #7016 is feat(factories): add Factories sidebar entry with list and drill-in views OpenHands#19800 (open).Issue Number
#5751
How to Test
uv run pytest tests/cross/test_verify_agent_server_skill.py tests/cross/test_verify_sdk_skill.py→ 96 passed.Evidence (README):
https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/agent-server-report-main.md):every replayed bullet of the 34 families, including re-runs.https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/agent-server-report-shim.md):F09, F21–F23 and F30–F34 without the key gap.https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/agent-server-report-verifier.md):F18, F36, F34 and F19 from this branch. [F36 re-verification](https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/agent-server-report-f36-reverify.md):after the memory-rest and memory-tool fixes.https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/sdk-report-main.md) and [SDK verifier](https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/sdk-report-verifier.md).https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/edited/F36/F36.flag-off/create.json)answers 404Projects are turned off. [Back on](https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/edited/F36/F36.flag-off/on-again.json),the same projects are served without a restart.https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/edited/F36/F36.runtime-env/host-off.json)wins over the stored switch.https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/edited/F36/F36.pull-requests/board.json)showspull_requestsfrom agh pr createresult.https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/edited/F18/F18.experimental-switch/after-restart.json).F18.experimental-file-changes: [an edit on disk switches projects off](https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/edited/F18/F18.experimental-file-changes/edited-off.json).https://github.com/enyst/openhands-evidence/blob/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/edited/sdk/S-wt-S03-route/transcripts).Video/Screenshots
The Agent Server changes here are the
projectsflag (#6602) and the routes it gates. The Canvas feature is F30 (Settings → Experimental), on Canvas 0f4cb6a against an Agent Server built from main@3a893a1b.[F30.open: the Projects switch from #6602, off by default](
https://raw.githubusercontent.com/enyst/openhands-evidence/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/ui/projects-off.png)[F30.toggle: Projects switched on; GET /api/projects answered 200 at once](
https://raw.githubusercontent.com/enyst/openhands-evidence/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/ui/projects-on.png)[Canvas home with Projects on: no Projects UI yet (OpenHands/OpenHands#19495)](
https://raw.githubusercontent.com/enyst/openhands-evidence/cfc9bdcefb92505deccdaa84bda7fcd68e093052/software-agent-sdk/map-maintenance/2026-11-21/ui/projects-on-home.png)Type
Notes
The branch has the pass's commit plus three F36 recipe fixes, which came out of the independent re-runs. Squash on merge.
Generated by Claude Code
🐳 Agent Server images for this PR — GHCR package, pull/run commands, and all pushed tags (click to expand)
• GHCR package: https://github.com/OpenHands/agent-sdk/pkgs/container/agent-server
Variants & Base Images
eclipse-temurin:17-jdkpython-node-runtimepython-node-runtimepython-node-runtimegolang:1.21-bookwormPull (multi-arch manifest)
# Each variant is a multi-arch manifest supporting both amd64 and arm64 docker pull ghcr.io/openhands/agent-server:4426d3f-pythonRun
All tags pushed for this build
About Multi-Architecture Support
4426d3f-python) is a multi-arch manifest supporting both amd64 and arm644426d3f-python-amd64) are also available if needed