Skip to content

feat(llamacpp): unload idle models, report real GPU use, prune old builds, hold context to the trained length - #323

Open
dovvnloading wants to merge 7 commits into
mainfrom
feat/runtime-unload-and-hygiene
Open

dovvnloading wants to merge 7 commits into
mainfrom
feat/runtime-unload-and-hygiene

Merge origin/main into feat/runtime-unload-and-hygiene

4edeae9
Select commit
Loading
Failed to load commit list.