Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
beb261a
docs(verify-sdk): link filed issues and drop history from known failures
enyst Nov 11, 2026
3d29078
docs(verify): in-progress map entries for the PR-status route and ACP…
enyst Nov 11, 2026
07e3bb9
docs(verify): in-progress map entries (continued)
enyst Nov 11, 2026
faeba5e
docs(verify): in-progress map entries (continued)
enyst Nov 11, 2026
391b554
docs(verify-agent-server): F27 resume-without-module bug now fails at…
enyst Nov 11, 2026
e776f87
fix(verify-sdk): close the S01 structured-output probes when run() ra…
enyst Nov 11, 2026
edff671
docs(verify): bug evidence from the 2026-11-11 map pass
enyst Nov 11, 2026
c5f588f
docs(verify): link today's issues (#6745-#6749) in both maps
enyst Nov 11, 2026
c707d37
docs(verify-agent-server): link the Canvas follow-ups for the PR-stat…
enyst Nov 11, 2026
1ecd2de
docs(verify): S04 damaged event files reopen (#6669); F21 note points…
enyst Nov 11, 2026
72c707d
docs(verify): evidence for the tmux plain follow-up interrupt
enyst Nov 11, 2026
0da9cf8
docs(verify-sdk): S04 interactive REPL known failure (#6752)
enyst Nov 11, 2026
1f2576d
docs(verify): move the agent-server map baseline to 5ff99f1; pass evi…
enyst Nov 11, 2026
068879a
Merge origin/main into map maintenance
enyst Nov 12, 2026
d916922
docs(verify-agent-server): F01-F11 and F20-F24 replayed on 9bf835c
enyst Nov 12, 2026
a0644a9
docs(verify-sdk): S11-S21 replayed live on 9bf835c
enyst Nov 12, 2026
4cd6bcc
docs(verify-agent-server): F12-F19 and F37 replayed on 9bf835c
enyst Nov 12, 2026
adb3d93
docs(verify-agent-server): F37.rest-response-parent, known bug #6782
enyst Nov 12, 2026
6d8f16c
docs(verify-agent-server): F25-F34 replayed on 9bf835c
enyst Nov 12, 2026
ae2134f
docs(verify-agent-server): F02 gotcha in the present tense
enyst Nov 12, 2026
cd2bae1
docs(verify-sdk): tighten S11, S16 and S17 checks after the re-check
enyst Nov 12, 2026
fb417f7
docs(verify-sdk): S01-S10 replayed live on 9bf835c
enyst Nov 12, 2026
31224c4
docs(verify-agent-server): link the Canvas follow-ups for reactions a…
enyst Nov 12, 2026
ae8860e
docs(verify-agent-server): F26, F27, F31 and F34 prose matches what t…
enyst Nov 12, 2026
b74ddf4
docs(verify-sdk): S08 resume and S02 compliance checks catch their fa…
enyst Nov 12, 2026
5cb22b8
docs(verify-sdk): S15.tabs known failure #6785 in its own bullet
enyst Nov 12, 2026
4cbd1fe
docs(verify): move both map baselines to 9bf835c
enyst Nov 12, 2026
b5e2168
docs(verify-sdk): S08 resume prose names the persisted agent; S15 #66…
enyst Nov 12, 2026
1062172
Merge origin/main into map maintenance
enyst Nov 12, 2026
031dcf3
docs(verify-agent-server): F37.rest-response-parent passes; F12 pause…
enyst Nov 12, 2026
ab93d92
docs(verify-agent-server): F03-F07 replayed on fb75ae9
enyst Nov 12, 2026
e754ca6
docs(verify-sdk): S01-S20 replayed on fb75ae9; history notes removed
enyst Nov 12, 2026
1315463
docs(verify): move both map baselines to fb75ae9
enyst Nov 12, 2026
3b20131
Merge main into map maintenance 2026-11-12
claude Nov 14, 2026
e651063
docs(verify): S11.task-secrets passes since #6757
claude Nov 14, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -105,7 +105,9 @@ Preconditions:
network namespace (`unshare -rn`, so nothing outside it can connect, and
port 8000 is free in every replay), it runs this checkout's server the way
an operator would (`python -m openhands.agent_server`, no `--host` unless
given, default port 8000) with its own `HOME` and config, waits until
given, default port 8000) with its own `HOME` and config and
`LITELLM_LOCAL_MODEL_COST_MAP=True` (the namespace has no network, and a
failed cost-map fetch at `import litellm` can crash startup, #6749), waits until
`/proc/net/tcp` shows the listening socket, stops the server, prints its
log and `listening on ADDRESS:8000`, and fails if nothing listened.
Needs `unshare` (util-linux) with unprivileged user namespaces, or root.
Expand Down Expand Up @@ -143,7 +145,7 @@ Preconditions:
cd "$dir" || exit 1
printf '{"preload_tools": false, "enable_vscode": false}\n' > config.json
HOME="$dir/home" OH_PERSISTENCE_DIR="$dir/home/.openhands" OPENHANDS_AGENT_SERVER_CONFIG_PATH="$dir/config.json" \
COLUMNS=400 PYTHONUNBUFFERED=1 "$QA_F02_PYTHON" -m openhands.agent_server "$@" > server.log 2>&1 &
LITELLM_LOCAL_MODEL_COST_MAP=True COLUMNS=400 PYTHONUNBUFFERED=1 "$QA_F02_PYTHON" -m openhands.agent_server "$@" > server.log 2>&1 &
pid=$!
addr=
for _ in $(seq 240); do
Expand Down Expand Up @@ -546,6 +548,13 @@ Preconditions:
commands run as the server's user and can read `/proc/<server pid>/environ`.
- `restart --env` values persist for later restarts of the same run; this
family leaves `OH_SESSION_API_KEYS_1` and the CORS variables on its run.
- `bind.sh` sets `LITELLM_LOCAL_MODEL_COST_MAP=True` because the private
namespace has no network: without it LiteLLM's remote cost-map fetch fails
at import and startup crashes most of the time with an `ImportError`
(`LoggerContext` from a partially initialized
`litellm.rust_bridge.catalog`) or a `_DeadlockError` (#6749, also hit by
`F24.offline-safe`), so `F02.default-bind` would fail for a reason
unrelated to the bind address.
- With keys configured and no `--host`, the server binds `0.0.0.0`; without
keys, `127.0.0.1` (`F02.default-bind`). The launcher always passes
`--host 127.0.0.1`, so only `F02.default-bind` sees the default.
Original file line number Diff line number Diff line change
Expand Up @@ -173,8 +173,8 @@ Preconditions:
rewritten by the 5xx handler, so assert on the status and on `exception`,
which carries `server is in deferred-init state 'dormant'; call POST
/api/init first`. The workspace file route is mounted on its own `/api`
router (cookie auth), which carries the same gate since #5700, so it no
longer reaches the missing conversation service.
router (cookie auth), which carries the same gate, so it never reaches
the missing conversation service.
- **Dormant sockets (`F03.dormant-gates-sockets`).** Every WebSocket is refused at the handshake while dormant.
```sh
F03_ZERO=00000000-0000-0000-0000-0000000000f3
Expand Down Expand Up @@ -557,11 +557,9 @@ Preconditions:
client as an HTTP 403 handshake rejection (`ws listen --expect-reject 403`),
not as a 1013 close frame. An unknown socket path is also a 403, so pair
the dormant check with the same socket opening after init.
- The gate precedes every auth check since #5700 (`F03.gate-before-auth`), so
- The gate precedes every auth check (`F03.gate-before-auth`) and covers the
workspace static-file routes, the sockets, `/v1` and `/app-backends`, so
while dormant a 503 says nothing about the key; prove a key only after init.
Before #5700 the workspace static-file routes, the sockets, `/v1` and
`/app-backends` were outside the gate (#5661, #5700 closed them); a baseline
checkout older than those PRs answers those recipes differently.
- The bootstrap `X-Init-API-Key` is the dormant `secret_key`, which defaults to
the first session key when `OH_SECRET_KEY` is unset and is **open to anyone**
when neither is set (`F03.init-open-without-secret`). `control-agent-server
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ Routes: `GET /api/conversations/search`, `GET /api/conversations/count`,
- `F04.patch-errors`: an empty or 201-character title, a bad tag key and a malformed id are 422; no key is 401; the stored values are untouched.
- `F04.patch-whitespace-title`: a whitespace-only title is rejected instead of erasing the stored title.
- `F04.patch-unknown-id`: PATCH on an unknown id answers the 404 the OpenAPI document declares, not 200 `{"success": false}`.
- `F04.delete`: DELETE stops a running conversation (`PauseEvent`, `InterruptEvent`), removes its state, keeps the workspace, removes a worktree conversation's worktree but keeps its branch, orphans children, and later reads are 404 (socket close 4004); a malformed id is 422 and no key is 401.
- `F04.delete`: DELETE closes the conversation's open sockets with 4004, stops a running conversation, removes its state, keeps the workspace, removes a worktree conversation's worktree but keeps its branch, orphans children, and later reads are 404 (socket close 4004); a malformed id is 422 and no key is 401.
- `F04.delete-unknown-id`: DELETE on an unknown or already deleted id answers the 404 the OpenAPI document declares, not 400.
- `F04.restart-persist`: after a restart the catalog, statuses, titles, tags, final responses and event replay are unchanged, and deleted conversations stay deleted.
- `F04.read-no-hydrate`: after a restart, GET, the batch get, search and count read a cold conversation without loading it (no `owner_lease.json`), while `agent_final_response` loads it and claims the lease.
Expand Down Expand Up @@ -85,9 +85,9 @@ Routes: `GET /api/conversations/search`, `GET /api/conversations/count`,
`DELETE /api/conversations/{conversation_id}`.
- WebSocket (owned by the events family, used here as a second view):
`/sockets/events/{conversation_id}` replays the initial message and run,
pushes `ConversationStateUpdateEvent` key `tags` on PATCH, `PauseEvent` and
`InterruptEvent` when a running conversation is deleted, and closes with 4004
for a deleted id.
pushes `ConversationStateUpdateEvent` key `tags` on PATCH, closes an open
socket with 4004 when its conversation is deleted, and closes with 4004 for
a deleted id.
- SDK: `RemoteConversation(agent=..., workspace=RemoteWorkspace(...))` posts
the create (and re-attaches with `conversation_id`), reads state with
`GET /api/conversations/{id}`, `set_title()` sends the PATCH, and `close()`
Expand Down Expand Up @@ -656,8 +656,7 @@ EOF
N4=$(control-agent-server api GET /api/conversations/count --field .)
control-agent-server ws start "/sockets/events/$DEL" --name qa-f04-delete --duration 60
control-agent-server api DELETE "/api/conversations/$DEL" --expect 200 --check success eq true --timeout 30 --save F04.delete/delete
control-agent-server ws read qa-f04-delete --kinds PauseEvent --expect-min 1 --wait 15
control-agent-server ws stop qa-f04-delete --kinds InterruptEvent --expect-min 1 --wait 15 --save F04.delete/live
control-agent-server ws stop qa-f04-delete --kinds PauseEvent,InterruptEvent --expect-none --expect-close 4004 --save F04.delete/live
control-agent-server api GET "/api/conversations/$DEL" --expect 404 --save F04.delete/get-after
control-agent-server api GET "/api/conversations/$DEL/agent_final_response" --expect 404
control-agent-server api GET /api/conversations --query ids="$DEL" --check 0 eq null
Expand All @@ -673,8 +672,10 @@ EOF
if git -C "$REPO" worktree list | grep -q "worktrees/$WT/"; then false; fi
test -n "$(git -C "$REPO" branch --list "openhands/$WT")"
```
The running conversation is paused and interrupted, then gone from every
read view and from disk; the workspace file and the child (with a dangling
The open socket is closed with 4004 `Conversation deleted` before the
DELETE answers and before the running conversation is paused and
interrupted, so it receives no `PauseEvent` or `InterruptEvent`; the
conversation is then gone from every read view and from disk; the workspace file and the child (with a dangling
`parent_conversation_id`) remain. The worktree conversation's worktree is
removed (directory and `git worktree` entry) while its branch stays. A repeated
delete and an unknown id are `F04.delete-unknown-id`.
Expand Down Expand Up @@ -896,9 +897,10 @@ EOF
- `parent_conversation_id` needs the same `working_dir` as the parent. DELETE
does not cascade: children keep a dangling `parent_conversation_id`, and a
worktree and its `openhands/<id>` branch stay behind.
- An events socket that was already open during a DELETE receives the pause
frames and then a 4004 close before the DELETE answers; new connections
get 4004 too (`F06.ws-delete-close`).
- An events socket that was already open during a DELETE gets a 4004 close
before the DELETE answers, and before the run is paused, so it sees no
pause or interrupt frames (`F04.delete`); new connections get 4004 too
(`F06.ws-delete-close`).
- Saved LLM profiles cannot be named in `agent_settings`; start from one with
`agent_profile_id` (an Agent Profile whose `llm_profile_ref` names it), as
in `F04.create-agent-profile`.
Expand Down
Loading
Loading