torch-npu

Here are 3 public repositories matching this topic...

Ascend NPU fork of nanochat for LLM training with torch_npu/HCCL (experimental)

pytorch cann npu ascend llm llm-training hccl nanochat huawei-ascend torch-npu

Mini-SGLang port for Ascend NPUs with FIA, paged KV cache, ragged continuous batching, and request lifecycle safety.

inference-engine ascend kv-cache llm llm-serving llm-inference ascend-npu qwen paged-attention sglang continuous-batching torch-npu mini-sglang

Run nanochat training efficiently on Huawei Ascend NPUs with minimal code changes, supporting tokenizer, pretraining, and evaluation workflows.

pytorch cann npu ascend llm llm-training hccl nanochat huawei-ascend torch-npu

Add a description, image, and links to the torch-npu topic page so that developers can more easily learn about it.

To associate your repository with the torch-npu topic, visit your repo's landing page and select "manage topics."