Skip to content

feat(thead): support FlashAttention on PPU - #985

Merged
voltjia merged 1 commit into
masterfrom
feat/thead-flash-attn
Sep 11, 2026
Merged

voltjia merged 1 commit into
masterfrom
feat/thead-flash-attn

Conversation

@spike-zhu

@spike-zhu spike-zhu commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Summary

  • support flash-attn in thead ppu

Motivation

Closes #

Type of Change

  • feat — new feature / new operator / new platform
  • fix — bug fix
  • perf — performance improvement (no behavioral change)
  • refactor — code restructuring without behavior change
  • test — adding or fixing tests only
  • docs — documentation only
  • build / ci — build system or CI configuration
  • chore — tooling, formatting, or other non-code changes
  • Breaking change (requires a ! in the Conventional Commits prefix or a BREAKING CHANGE: footer)

Platforms Affected

  • CPU (WITH_CPU)
  • NVIDIA (WITH_NVIDIA)
  • Iluvatar (WITH_ILUVATAR)
  • MetaX (WITH_METAX)
  • Cambricon (WITH_CAMBRICON)
  • Moore (WITH_MOORE)
  • Ascend (WITH_ASCEND)
  • T-Head (WITH_THEAD)
  • PyTorch C++ bindings (WITH_TORCH)
  • Build system / CMake / CI
  • Python bindings / user-facing API

Smoke Test Result

paste smoke test output here

Test Results on Supported Platforms

Platform Affected Build / Smoke Result Full Result / Notes
NVIDIA
Iluvatar
MetaX
Cambricon
Moore
Ascend
Full `pytest` output (optional)
paste here

Benchmark / Performance Impact

Notes for Reviewers

9g8b and 9g70b test result:

image

@spike-zhu
spike-zhu requested a review from a team September 11, 2026 07:11
@spike-zhu spike-zhu self-assigned this Sep 11, 2026
@spike-zhu
spike-zhu requested a review from voltjia September 11, 2026 07:13
@voltjia
voltjia merged commit 6d419d4 into master Sep 11, 2026
12 of 20 checks passed
@voltjia
voltjia deleted the feat/thead-flash-attn branch September 11, 2026 07:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants