Skip to content

feat(quantization): support compressed-tensors W8A8 and mixed modules - #582

Open
sam0336 wants to merge 8 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
sam0336:feat/compressed-tensors-w8a8
Open

feat(quantization): support compressed-tensors W8A8 and mixed modules#582
sam0336 wants to merge 8 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
sam0336:feat/compressed-tensors-w8a8

test(quantization): cover real Qwen3 W8A8 config

29ddfb9
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs