ggml-metal: add chunked SSD MMA for Mamba-2 prefill optimization - #26647

Merged

ggerganov merged 15 commits into

ggml-org:masterfrom

dpantaleoni:ssd-metal

Aug 26, 2026

Commits on Aug 26, 2026

metal: WIP chunked SSD SSM_SCAN kernels for multi-token prefill
dpantaleoni
committed
c375a5a
metal: drop scalar SSD path; MMA + sequential tail
dpantaleoni
committed
778f64c
drop WIP ssm scan test noise

dpantaleoni
authored and
dpantaleoni
committed
6edd9bb
remove state_from_dst and rename CS and NSG constants

dpantaleoni
authored and
dpantaleoni
committed
895c55e
remove unrelated added whitespace padding

dpantaleoni
authored and
dpantaleoni
committed
b978c8f
added clarity to mma_tokens calculation

dpantaleoni
authored and
dpantaleoni
committed
a4725e4
added clarity to use_mma bool checks

dpantaleoni
authored and
dpantaleoni
committed
15668be
added comments to metal ssd op constants for clarity

dpantaleoni
authored and
dpantaleoni
committed
5b2d152
reserve K tokens for sequential kernel rollback snapshots
dpantaleoni
committed
4820ff8
reset concurrency between mma and seq tail
dpantaleoni
committed
559a766
remove print args no longer used
dpantaleoni
committed
61922f6
fixed comment to no longer point to specific line
dpantaleoni
committed
0c4872d
add FC_SSM_SCAN so seq path skips token offlset unless it's mma tail
dpantaleoni
committed
0bc1e22
added changes to new ssm.metal for rebase after ggml-metal.metal refactor
dpantaleoni
committed
f19941d
specialize ssm_scan tail with a template instead of a function constant
forforever73
committed
3954a13