Skip to content

Commit d1b685c

Browse files
Record a live CPU GGUF generation smoke for the managed llama.cpp runtime.
Co-authored-by: Cursor <cursoragent@cursor.com>
1 parent eaff0eb commit d1b685c

1 file changed

Lines changed: 19 additions & 4 deletions

File tree

‎docs/SIMPLIFICATION_REPORT.md‎

Lines changed: 19 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -45,6 +45,23 @@ daemon.
4545
Install path: `~/.local/lib/shadowcode/llama-server` with `$ORIGIN` rpath.
4646
- One model is loaded at a time on 127.0.0.1. Local vision is true only when an
4747
mmproj companion file is present next to the GGUF.
48+
- Live CPU generation smoke (2026-09-23): official
49+
`Qwen/Qwen2.5-0.5B-Instruct-GGUF` `qwen2.5-0.5b-instruct-q4_k_m.gguf`
50+
(491400032 bytes, sha256
51+
`74a4da8c9fdbcd15bd1f6d01d621410d31c6fc00986f5eb687824e7b93d7a9db`,
52+
URL
53+
`https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF/resolve/main/qwen2.5-0.5b-instruct-q4_k_m.gguf`)
54+
at `~/.local/share/shadowcode/models/`. Added through
55+
`POST /api/local-models/add` / `inspect_gguf`. `GET /api/picker` listed it
56+
under group `local` as `qwen2.5-0.5b-instruct-q4_k_m · This computer` with
57+
subtitle `Runs on this computer · No subscription quota` (UI section
58+
"On this computer"). Vision false (no mmproj). Managed
59+
`~/.local/lib/shadowcode/llama-server` (CPU build, commit `18f9f7bef`)
60+
loaded the GGUF on 127.0.0.1 and returned: "Python's zip() function
61+
returns an iterator that yields tuples containing elements from each of
62+
the iterables passed to it." `llama-cli` on the same file answered the
63+
same question. GPU was visible to `nvidia-smi` (RTX 5060 Ti) but this
64+
runtime has no CUDA/Vulkan; tokens were CPU. No AppImage rebuild.
4865

4966
## Tests and packaging
5067

@@ -69,9 +86,7 @@ AppImage build and install happen after this commit. Binaries under
6986

7087
- No hosted ShadowCode account or cloud orchestration.
7188
- Antigravity quota API is not in CLI 1.2.8. Antigravity images stay rejected.
72-
- No compatible chat GGUF was present on this machine, so a live load/generation
73-
smoke against user weights was not run. The managed binaries were proven with
74-
`--version`, and a unit test proves the engine resolves the bundled path
75-
rather than PATH-only.
89+
- The 0.5B Q4_K_M smoke proves load + text generation only. It is not a
90+
coding-quality model and was not used to claim agent/tool-calling quality.
7691
- GPU llama.cpp was not built: CUDA toolkit is absent and Vulkan shader tools
7792
are missing. CPU inference is what ships.

0 commit comments

Comments
 (0)