Skip to content

perf(krea2): use cuDNN SDPA with native GQA - #5

Merged
DualChimerra merged 1 commit into
claude/windows-fixes-anima29bfrom
codex/krea2-cudnn-gqa
Sep 20, 2026
Merged

DualChimerra merged 1 commit into
claude/windows-fixes-anima29bfrom
codex/krea2-cudnn-gqa

Conversation

@DualChimerra

Copy link
Copy Markdown
Owner

Summary

  • replace Krea2's manual 12-to-48 K/V head expansion with native PyTorch GQA
  • select the official cuDNN SDPA backend on CUDA when the current operands are supported
  • retain normal PyTorch SDPA selection as a safe fallback for CPU and unsupported shapes
  • document the effective Krea2 attention path

Validation

  • 147 Krea2 and family integration tests passed
  • 87 related modeling, sampling, and block-swap tests passed
  • CPU native-GQA output matches explicit K/V expansion
  • RTX 4070 Ti CUDA smoke test selected cuDNN SDPA for Krea2's 48/12 heads and completed forward/backward with finite outputs and gradients

@DualChimerra
DualChimerra merged commit ecb725b into claude/windows-fixes-anima29b Sep 20, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant