Repository navigation
Add MI300X FlyDSL BF16 GEMM tasks with strict cold-cache validation - #136
Merged
Merged
Conversation
…/Aiter-task-mi300 Each variant is its tasks/Aiter-task original with the gfx942 platform, an implemented starting candidate (AITER dbd8bf5's FlyDSL split-K HGEMM joined into kernel.py) and an initial-state check in evaluate.py that follows config.yaml. Workloads, inputs, reference, comparator, timing and baseline entry are the originals'. example_configs/task_validator_aiter_mi300x.yaml pins the image the variants were run in. Co-authored-by: Cursor <cursoragent@cursor.com>
…the READMEs The initial candidates measured 0.23, 0.55 and 0.48 of the baseline under the current task harness, and the baseline dispatch was unchanged: hipBLASLt for every case, plus AITER's skinny kernel for three small-M cases of n128_k6144. Co-authored-by: Cursor <cursoragent@cursor.com>
zili-amd
requested review from
irvineoy,
sharareh-y and
sinarafati-amd
as code owners
October 22, 2026 23:46
Contributor
Author
Require correct gfx942 baselines and measure one complete operator graph replay after a read-only 1 GiB eviction sweep. Preserve all workload, numerical, input mutation and changed-weight controls, retain raw samples and cache identity, and require graph replay review for both cold graph methods. Add regression coverage and a runnable timing reference; keep historical warm-cache results distinct.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add gfx942 (MI300X) variants of three BF16 GEMM tasks under
tasks/Aiter-task-mi300:gemm_a16w16_nt_n128_k6144,gemm_a16w16_nt_n2048_k2048, andgemm_a16w16_nt_n6144_k6144.Each task starts from a working FlyDSL kernel based on AITER
dbd8bf5bd624120197a7a26780a8c72201824f0f, with its helper modules joined into one task-local file. The agent optimizes that implementation. The original 13 cases, inputs, reference, comparator and candidate numerical gate remain unchanged.The baseline is the installed AITER dispatch: hipBLASLt on gfx942, plus AITER's skinny kernel for some small-M cases. All three tasks require baseline correctness; gfx950 diagnostic exceptions do not apply.
Both roles now use
cuda_graph_cold_cache: prepare inputs, perform a read-only 1 GiB eviction sweep, then time one complete operator graph replay with same-stream GPU Events. The 20 warmups and 100 samples remain unchanged. Raw samples and cache identity are retained, and the existing current-weight, input-mutation and unseen-draw checks remain active. Graph capture failures cannot silently use Event fallback.Shared helper, parser, pairing and validator support enforce that timing identity and require graph replay review. The runnable cold-cache reference and focused regression tests are included.
Validation
The example validator config pins the tested runtime image by digest:
docker.io/primussafe/sglang@sha256:1bdb3a9f1c068255d5d631ba4ce80df7f27223f582b8f70036040ea6fc497370Validation of frozen revision
d74c10b9ef1e833082c75cb0fb2f17a8274f0b43on 2026-10-27:overall_status: PASS, with matching completion markers; all 12 checks passed for each task. GPU actions ran in the pinned runtime. Semantic review used a hash-verified source/evidence mirror, and the original scoring runtime finalized the unchanged GPU evidence with fresh request IDs and evidence digests.This qualification establishes task correctness and benchmark integrity. It does not establish an optimization speedup.
The initial GPU results from 2026-10-22 used the earlier warm-graph protocol. They remain in the task READMEs as historical evidence and do not qualify this revision or establish cold-cache speedups. Changing the cache policy changes benchmark identity; both baseline and candidate must be measured again.