@@ -45,6 +45,23 @@ daemon.
4545 Install path: ` ~/.local/lib/shadowcode/llama-server ` with ` $ORIGIN ` rpath.
4646- One model is loaded at a time on 127.0.0.1. Local vision is true only when an
4747 mmproj companion file is present next to the GGUF.
48+ - Live CPU generation smoke (2026-09-23): official
49+ ` Qwen/Qwen2.5-0.5B-Instruct-GGUF ` ` qwen2.5-0.5b-instruct-q4_k_m.gguf `
50+ (491400032 bytes, sha256
51+ ` 74a4da8c9fdbcd15bd1f6d01d621410d31c6fc00986f5eb687824e7b93d7a9db ` ,
52+ URL
53+ ` https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct-GGUF/resolve/main/qwen2.5-0.5b-instruct-q4_k_m.gguf ` )
54+ at ` ~/.local/share/shadowcode/models/ ` . Added through
55+ ` POST /api/local-models/add ` / ` inspect_gguf ` . ` GET /api/picker ` listed it
56+ under group ` local ` as ` qwen2.5-0.5b-instruct-q4_k_m · This computer ` with
57+ subtitle ` Runs on this computer · No subscription quota ` (UI section
58+ "On this computer"). Vision false (no mmproj). Managed
59+ ` ~/.local/lib/shadowcode/llama-server ` (CPU build, commit ` 18f9f7bef ` )
60+ loaded the GGUF on 127.0.0.1 and returned: "Python's zip() function
61+ returns an iterator that yields tuples containing elements from each of
62+ the iterables passed to it." ` llama-cli ` on the same file answered the
63+ same question. GPU was visible to ` nvidia-smi ` (RTX 5060 Ti) but this
64+ runtime has no CUDA/Vulkan; tokens were CPU. No AppImage rebuild.
4865
4966## Tests and packaging
5067
@@ -69,9 +86,7 @@ AppImage build and install happen after this commit. Binaries under
6986
7087- No hosted ShadowCode account or cloud orchestration.
7188- Antigravity quota API is not in CLI 1.2.8. Antigravity images stay rejected.
72- - No compatible chat GGUF was present on this machine, so a live load/generation
73- smoke against user weights was not run. The managed binaries were proven with
74- ` --version ` , and a unit test proves the engine resolves the bundled path
75- rather than PATH-only.
89+ - The 0.5B Q4_K_M smoke proves load + text generation only. It is not a
90+ coding-quality model and was not used to claim agent/tool-calling quality.
7691- GPU llama.cpp was not built: CUDA toolkit is absent and Vulkan shader tools
7792 are missing. CPU inference is what ships.
0 commit comments