Skip to content

feat(server): keep evicted models in host RAM and wake them instead of reloading - #834

Open
svonava wants to merge 2 commits into
mainfrom
feat/host-ram-swap
Open

feat(server): keep evicted models in host RAM and wake them instead of reloading#834
svonava wants to merge 2 commits into
mainfrom
feat/host-ram-swap

fix(server): keep aliases and LoRA state intact across park and wake

dcbd650
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar