Skip to content

Let llama.cpp own boot warmup - #17

Merged
SoryAK merged 2 commits into
mainfrom
fix/llama-cpp-owns-warmup
Sep 9, 2026
Merged

Let llama.cpp own boot warmup#17
SoryAK merged 2 commits into
mainfrom
fix/llama-cpp-owns-warmup

Conversation

@SoryAK

@SoryAK SoryAK commented Sep 9, 2026

Copy link
Copy Markdown
Owner

Summary

  • Stop MBA from POSTing /completion after llama.cpp is healthy (that 60s generate timed out on large models and killed the server).
  • Emit llama.cpp --warmup / --no-warmup from warmupTokens so the empty run happens during load.
  • Boot returns when /health is ok.

Test plan

  • systemctl --user restart mba so the daemon picks up the source change
  • mba s boot a model that previously failed with warmup failed: TimeoutError
  • CLI prints (waits for health)… and the spawn argv includes --warmup
  • Boot completes without MBA sending /completion

Made with Cursor

SoryAK and others added 2 commits September 9, 2026 17:59
MBA's 60s generate request timed out on large models and killed a healthy server.

Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
@SoryAK
SoryAK merged commit e005e3b into main Sep 9, 2026
3 checks passed
SoryAK added a commit that referenced this pull request Sep 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant