Skip to content

feat(qwen): add paged greedy MTP with FP8 block weights - #584

Open
big-hip wants to merge 3 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
big-hip:feat/qwen-greedy-mtp
Open

feat(qwen): add paged greedy MTP with FP8 block weights#584
big-hip wants to merge 3 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
big-hip:feat/qwen-greedy-mtp

fix(qwen): align packed verification with decode numerics

78d19f7
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs