Skip to content

perf: Qwen3 offline inference — hybrid attention backend, fused rms_norm_rope, chunked prefill + prompt-lookup spec decoding - #585

Open
shsaihdsaiudh wants to merge 4 commits into
InfiniTensor:mainfrom
shsaihdsaiudh:perf/perf-baseline
Open

perf: Qwen3 offline inference — hybrid attention backend, fused rms_norm_rope, chunked prefill + prompt-lookup spec decoding#585
shsaihdsaiudh wants to merge 4 commits into
InfiniTensor:mainfrom
shsaihdsaiudh:perf/perf-baseline

test: offline dual-engine perf baseline harness and gap analysis report

8c3a8d3
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs