Conversation
spike-zhu
marked this pull request as draft
September 11, 2026 07:59
spike-zhu
force-pushed
the
feat/support-thead-backend
branch
from
September 18, 2026 08:53
33b89ad to
6f824cb
Compare
spike-zhu
marked this pull request as ready for review
September 18, 2026 08:53
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add T-Head PPU support to InfiniCCL through the NCCL-compatible library shipped in the T-Head CUDA SDK.
The change introduces the T-Head device/runtime abstraction, registers the device in the backend-device map, and extends the NCCL backend so existing collective APIs can operate on T-Head PPU memory.
Changes
T-Head Backend
Add T-Head backend support to InfiniCCL.
Add T-Head device and runtime definitions.
Add T-Head NCCL-compatible API interfaces.
Device Management
Add T-Head device implementation and data type support.
Update backend-device mapping for the T-Head backend.
Build System
Update CMake configuration to build the T-Head backend.
Add the required T-Head backend source files and headers.
Platform and Backend Affected
Platform
Backend
Performance Impact
If applicable, provide benchmark results.
Known Issues & Future Work
Test Results
Test Involved Platform
Test Involved Backend
Checklist
Title, Branch, and Commits
feat: …,fix(nccl): …).<type>/xxx-yyyy-zzzzwhere<type>matches the PR title's Conventional Commits type and words are joined with hyphens (seeCONTRIBUTING.md§Branches).CONTRIBUTING.md§Pull Requests).master— the branch is rebased cleanly on top of the currentmaster.fixup!/squash!/wipcommits remain.Scope and Design
CONTRIBUTING.md§Code/General).printf/std::cout/print(...)left behind, orTODOwithout an owner and issue link.General Code Hygiene
CONTRIBUTING.md§Code/General).CONTRIBUTING.md§Code/General).the `AllReduce` implementation) (CONTRIBUTING.md§Code/General).CONTRIBUTING.md§Code/General).CONTRIBUTING.md§Code/General; §Python).C++ Specific (if C++ files changed)
clang-formatversion 16 has been run against all applicable modified files; the diff is clean.Python Specific (if Python files changed)
N/A. No Python source files are changed in this PR.
ruff checkandruff format --checkwere still run and passed.Testing
Build, CI, and Tooling
CMakeLists.txtunderif(AUTO_DETECT_DEVICES)or toif(AUTO_DETECT_BACKENDS)if applicable.clang-format.yml,ruff.yml) are green locally (or expected to be green on CI).Documentation
README.md,CONTRIBUTING.md, or inline docs updated when behavior, build flags, or developer workflow changed.Security and Safety