All issues

Search results

[Bug] DeepSeek V4 serving prepare_early spends 13-20 ms per decode step building metadata tables

Status: Open.

#215 In hw-native-sys/pypto-serving;

· high-cloud opened on Sep 1, 2026

[Feature] Serve DeepSeek-V4-Flash DSpark: target model e2e first, DSpark speculation next

enhancementNew feature or requestNew feature or request

Status: Open.

#211 In hw-native-sys/pypto-serving;

· ndleslx opened on Aug 29, 2026

[Bug] Qwen decode padding races on inactive rows during dynamic batches

Status: Open.

#201 In hw-native-sys/pypto-serving;

· Little-oil opened on Aug 27, 2026

[Bug] Flaky: DeepSeek V4 prefix-cache case returns different text for two identical requests

Status: Open.

#183 In hw-native-sys/pypto-serving;

· lterrac opened on Aug 21, 2026

[Feature] Add Mooncake-backed external prefix cache for DeepSeek V4

enhancementNew feature or requestNew feature or request

Status: Open.

#182 In hw-native-sys/pypto-serving;

· superxf opened on Aug 21, 2026

[Feature] 支持运行时可开关的 MoE 专家负载数据 Dump

Status: Open.

#181 In hw-native-sys/pypto-serving;

· high-cloud opened on Aug 21, 2026

[Bug] DeepSeek V4 decode step latency is unstable across ranks

Status: Open.

#179 In hw-native-sys/pypto-serving;

· high-cloud opened on Aug 21, 2026

[Feature] DeepSeek V4 continuous chunked prefill for grouped KV cache

Status: Open.

#175 In hw-native-sys/pypto-serving;

· vegetabledoww opened on Aug 20, 2026

[Docs] DeepSeek V4 分组 Prefix Cache 的零拷贝实现说明

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#167 In hw-native-sys/pypto-serving;

· superxf opened on Aug 18, 2026

[Refactor] Unify Qwen + DeepSeek weight loading behind a staged pipeline (spec → shard policy → slab stacker)

Status: Open.

#163 In hw-native-sys/pypto-serving;

· ndleslx opened on Aug 16, 2026

[Bug] DeepSeek V4 greedy MTP decode diverges from AR token output

Status: Open.

#161 In hw-native-sys/pypto-serving;

· vegetabledoww opened on Aug 15, 2026

[Refactor] Collapse the three-thread decode pipeline into a single-thread loop using PyPTO submit/wait

Status: Open.

#160 In hw-native-sys/pypto-serving;

· ndleslx opened on Aug 15, 2026