Skip to content

perf: avoid scanning KV cache pages for capacity checks - #576

Open
T4t4KAU wants to merge 1 commit into
InfiniTensor:InfiniLM-v0.2.9cfrom
T4t4KAU:perf/kv-cache-capacity-index
Open

perf: avoid scanning KV cache pages for capacity checks#576
T4t4KAU wants to merge 1 commit into
InfiniTensor:InfiniLM-v0.2.9cfrom
T4t4KAU:perf/kv-cache-capacity-index

Commits

Commits on Sep 17, 2026