Skip to content

docs: two Qwen 2.5 Coder 14B transcripts of find-and-kick, the local model evidence - #7

Open
Bayway wants to merge 3 commits into
rokbenko:mainfrom
Bayway:docs/qwen-transcripts
Open

docs: two Qwen 2.5 Coder 14B transcripts of find-and-kick, the local model evidence#7
Bayway wants to merge 3 commits into
rokbenko:mainfrom
Bayway:docs/qwen-transcripts

Conversation

@Bayway

@Bayway Bayway commented Sep 6, 2026

Copy link
Copy Markdown
Contributor

What

The two local-model transcripts you asked for in #5. docs/local-llms.md and the README said one contributor had run Qwen 2.5 Coder 14B on LM Studio and no transcript was in the repository; two are now, under docs/assets/transcripts/, with a table in local-llms.md that reads them and says what they cannot show.

  • seed 6, memory read: the previous run's episode sits in the system prompt under What you remember and the model never calls remember. Success in 8 steps, 9 LLM calls, two kicks fall short before the third connects.
  • seed 5, remember: the .duck body has remember in strategy step 5; the model calls it once with a fact from the verb results, then bundles quack and declare_success in one turn, which the loop records as multiple_tool_calls and keeps the first. Success in 4 steps, 6 LLM calls.

Every turn in both was a native tool call, none needed the JSON text fallback, 14 s and 11 s of wall clock. Recorded 2026-09-03 on an Apple M2 Pro, the day memory landed, with the branch that became #5 (the second one with the strategy-step change, the first without, which is the point). The only edit to the files is the removal of my home directory from duck_path.

Also touched: docs/assets/README.md (how they were made), the README's two sentences that said "no transcript", and CHANGELOG under Unreleased. No code.

Kind of change

  • New or changed verb
  • New or changed .duck file
  • Adapter / upstream API
  • Docs only
  • Other

Checklist

  • uv run ruff check . && uv run ruff format --check . && uv run mypy && uv run pytest pass locally (259 passed, including test_pypi_readme.py with the dev extra)
  • No network calls in tests; no API keys needed
  • No upstream assets, from Pollen Robotics or the Open Duck Mini project (logos, meshes, videos) added
  • CHANGELOG.md updated under Unreleased
  • uv run quackd validate ducks/*.duck passes (CI runs it)

🤖 Generated with Claude Code

Bayway and others added 3 commits September 6, 2026 11:59
…model evidence

The README and docs/local-llms.md said one contributor had run a local
model and no transcript was in the repository. Two are now, under
docs/assets/transcripts/: seed 6, where the previous run's episode sits in
the system prompt under "What you remember" and the model never calls
`remember`, and seed 5 after `remember` became strategy step 5, where it
calls it once with a fact from the verb results. Both successes, every turn
a native tool call, no text fallback, 14 s and 11 s of wall clock. Only the
contributor's home directory was removed from `duck_path`.

docs/local-llms.md reads them in a table and says what they cannot show;
docs/assets/README.md records how they were made; the README's two
sentences point at the folder; CHANGELOG under Unreleased.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
The local-llms table called 14 s and 11 s "wall clock"; that is the
simulator clock the budget counts on sim2d. The transcript timestamps
give 33 s and 29 s, three to nine seconds per LLM call, and the table now
says both. The seed 5 row read as if `remember` came alone and the bundle
followed; the model returned all three tools in one response and the loop
kept the first. The CHANGELOG entry no longer sits between the Unreleased
intro and the audit it introduces. assets/README says why `memory.path`
is relative, and memory.md points its "read but never wrote" claim at the
two files that show it.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GrWzSyBBfB33MFGYR8qUf9
…the transcripts change

main rewrote the flock bullet and the contributors row while this branch was open;
both are taken verbatim. The two lines that said no transcript is in the repository
are the ones this branch exists to change, so they are updated in the shorter voice
main now uses.
@Bayway

Bayway commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

Merged main into the branch; it is mergeable again.

Two files conflicted, both prose. Where main had rewritten text this PR has no business touching — the flock bullet under Known limits, the contributors.svg row in docs/assets/README.md — I took main's version verbatim. The two places that said no transcript is in the repository are the ones this PR exists to change, so I updated those in the shorter voice main now uses: the local-models row in the status table, and the "Local model quality is unmeasured" bullet.

The diff against main is now the two .jsonl files, their two rows in docs/assets/README.md, those two lines, and the docs/local-llms.md, docs/memory.md and CHANGELOG.md text from before.

One thing here is not from this branch: the Lint step fails with four errors, all in files this PR does not touch — tests/test_web.py:133 (E501), and web/serve.py (one RUF100, two T201). The same four are on main at ea271b0. Flagging it only so the red check on this PR is not read as coming from it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant