Skip to content

feat(engine): integrate prefix eviction and chunked parallel execution - #573

Open
big-hip wants to merge 9 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
big-hip:feat/cache-chunk-graphs
Open

feat(engine): integrate prefix eviction and chunked parallel execution#573
big-hip wants to merge 9 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
big-hip:feat/cache-chunk-graphs

test(engine): trim chunk validation scaffolding

6ab1130
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs