Skip to content

feat(mamba2): integrate model loading and recurrent inference - #575

Open
big-hip wants to merge 5 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
big-hip:feat/mamba2-model-inference
Open

feat(mamba2): integrate model loading and recurrent inference#575
big-hip wants to merge 5 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
big-hip:feat/mamba2-model-inference

test(layers): reuse prefill and decode regression setup

9a19d14
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs