Skip to content

sched: pipeline the delivery of a host-resident KV cache - #39

Open
Piggidragon wants to merge 29 commits into
GenerelSchwerz:llama/devfrom
Piggidragon:kv/pipelined-transport
Open

sched: pipeline the delivery of a host-resident KV cache#39
Piggidragon wants to merge 29 commits into
GenerelSchwerz:llama/devfrom
Piggidragon:kv/pipelined-transport

llama : wait for the decode before clearing the memory buffers

9fe8c48
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
labeler
succeeded Sep 6, 2026 in 14s