Skip to content

perf: Qwen3 offline inference — hybrid attention backend, fused rms_norm_rope, chunked prefill + prompt-lookup spec decoding - #585

Open
shsaihdsaiudh wants to merge 4 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
shsaihdsaiudh:perf/perf-baseline
Open

perf: Qwen3 offline inference — hybrid attention backend, fused rms_norm_rope, chunked prefill + prompt-lookup spec decoding#585
shsaihdsaiudh wants to merge 4 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
shsaihdsaiudh:perf/perf-baseline

Commits

Commits on Sep 20, 2026