Add DeepSeek-V4-Flash-0731 DwarfStar-4 (IQ2XXS) guide + card - #22
Merged
Conversation
Independent replication of a viral DGX-Spark deployment writeup + a 174-call Laguna-depth behavioral battery. Stack: antirez IQ2XXS quant (86.7GB) + bleysg DSpark drafter on Entrpi/ds4 v0.5.2, CUDA sm_121, GB10. Corrects the record: GGUF header shows 256 experts / ~21B-active deepseek4, NOT the writeup's 685B / 64-expert claim. Validated (on-box): decode 21-26 tok/s, TTFT 170-320ms (writeup claimed 3-16s), reasoning 8/8, tools 3/3, and concurrency to 24 sessions at 262K (100% success, peak ~78 tok/s at max_seq=21) which busts the 'only 2 concurrent' claim. Includes HF/GitHub links and single + parallel run recipes. Behavioral: does NOT reproduce our Config-I GGUF repetition-loop; strong refusal/spine/hallucination/tool-injection; two caveats documented with mitigations: a ~20-27% content-dump-into-content bug on reflective/ low-budget prompts (concise system prompt fixes it 4/4->0/4; enable_thinking: false backfires) and a fiction-framing jailbreak that partially defeats an otherwise-strong safety posture on this Q2 quant. Status EARLY: single tester, one day, one stack.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds an offlabel operating guide + card for DeepSeek-V4-Flash-0731 on DwarfStar-4 (antirez/ds4), the IQ2XXS asymmetric quant. This is a distinct stack from our existing Config-I GGUF guide (different quant, different engine), so it gets its own guide.
What this is: an independent replication of a viral DGX-Spark deployment writeup, plus a 174-call Laguna-depth behavioral battery. Single tester, one day, one stack (status: EARLY).
Corrects the record
The writeup describes this as "685B params, 64 routed experts." We parsed the GGUF header directly: it is
deepseek4, 256 experts, 6 active + 1 shared, ~21B active. The 685B/64-expert figure is DeepSeek-V3/R1-class numbers attached by association. Every throughput number should be read as a ~21B-active MoE.Validated on-box (nothing on the card is unmeasured)
Behavioral (all n stated, stack-labeled)
contenton reflective/low-budget prompts (emptiesreasoning_content, hitslength, never answers). Fixed by a concise system prompt (4/4 → 0/4).enable_thinking:falsebackfires. Retry heuristic documented.Lint (
scripts/check_guides.py) passes: frontmatter, required keys, no em/en-dashes.