w7800

Here is 1 public repository matching this topic...

Serve AMD's Quark W4A16 INT4 models on RDNA3 (gfx1100) via a lossless repack to SGLang's GPTQ path

quantization quark rocm amd-gpu int4 gptq llm-inference gfx1100 rdna3 sglang w4a16 w7800

To associate your repository with the w7800 topic, visit your repo's landing page and select "manage topics."