Repository navigation

Add native Cactus and Needle runtime - #116

Merged

gabewillen merged 166 commits into

mainfrom

feat/cact-needle-runtime

Sep 5, 2026

Merged

Add native Cactus and Needle runtime#116
gabewillen merged 166 commits into
mainfrom
feat/cact-needle-runtime

Commits on Aug 30, 2026
- wip(cact): loader events/errors/context
  EMEL Worker
  committed
  25f802b
- wip(cact): loader detail/guards/actions/sm/any
  EMEL Worker
  committed
  9355f62
- wip(cact): register loader sm alias and test source
  EMEL Worker
  committed
  dc38aef
- wip(cact): parity fixture generator + generated CSV
  EMEL Worker
  committed
  4f22bb3
- feat(cact): loader state/guard/effect prefixes, shard wiring, tests, pinned fixture
  EMEL Worker
  committed
  c5ac71a
- fix(tests): mark aarch64-only q4 seeding helper maybe_unused for x86 -Werror
  EMEL Worker
  committed
  f5aa58d
- fix(tests): mark aarch64-only kernel test helpers maybe_unused for x86 -Werror
  EMEL Worker
  committed
  25317d6
- chore(cact): benchmark scaffold marker on loader sm
  EMEL Worker
  committed
  2c247cc
- fix(model): elaborate topology member type for gcc-14 -Wchanges-meaning
  EMEL Worker
  committed
  18a6e94
- style: clang-format cact loader, tests, and drifted baseline files
  EMEL Worker
  committed
  89fd9b0
- feat(needle): positional-to-named model binding and tokenizer blob loader
  EMEL Worker
  committed
  a6cac6e
- style: clang-format needle binding and tokenizer sources
  EMEL Worker
  committed
  7ac5972
- chore(needle): benchmark scaffold markers on binder and tokenizer loader machines
  EMEL Worker
  committed
  7a8ecda
- chore(gates): refresh quality_gates timing after scoped needle run
  EMEL Worker
  committed
  65354cf
- feat(kernel): add native CQ2 CQ3 CQ4 GEMV kernels
  EMEL Worker
  committed
  158a313
- fix(kernel): make CQ routes explicit in SML guards
  EMEL Worker
  committed
  18e1c83
- fix(kernel): avoid runtime cpu probe in CQ route guard
  EMEL Worker
  committed
  59044b9
- feat(cact): JAX logits parity fixture generator + committed 3-case fixture
  EMEL Worker
  committed
  38ccef1
- feat(kernel): needle stage kernels — zcrms, rope, swa, hadamard, engram, mhc + CQ row routes
  EMEL Worker
  committed
  5db8684
- feat(needle): native graph machine with JAX logits parity
  EMEL Worker
  committed
  0e10661
- fix(kernel): compile-time gate aarch64 f32 GEMV route; recognized benchmark markers
  EMEL Worker
  committed
  71a357b
- style: clang-format cq kernel sources and tests
  EMEL Worker
  committed
  9b299fc
- chore(gates): refresh quality_gates timing after scoped needle graph run
  EMEL Worker
  committed
  aafe017
- docs: generated machine docs for needle graph and stage kernels
  EMEL Worker
  committed
  bac6abf
- feat(bench): needle graph decode/prefill single-core suite
  EMEL Worker
  committed
  7909033
- feat(tools): needle heldout accuracy eval
  EMEL Worker
  committed
  32afb6e
- perf(cq): decode q4 nibbles in AVX2 registers
  EMEL Worker
  committed
  71d909d
- perf(cq): prepare exact q4 graph weights
  EMEL Worker
  committed
  f91a16e
- perf(cq): prepare fp16 cq units
  EMEL Worker
  committed
  2f2e04d
- Revert "perf(cq): prepare fp16 cq units"
  EMEL Worker
  committed
  8fc0ea1
- perf(cq): add exact packed pair LUT route
  EMEL Worker
  committed
  241dc57
- perf(swa): vectorize exact ring attention
  EMEL Worker
  committed
  e2cb74b
- Revert "perf(cq): add exact packed pair LUT route"
  EMEL Worker
  committed
  a682b1c
- test(needle): add authoritative W4A8 logits fixture
  EMEL Worker
  committed
  2d56766
- feat(needle): execute explicit W4A8 deployment route
  EMEL Worker
  committed
  aa7180a
- perf(cq): add exact row-major multirow kernels
  EMEL Worker
  committed
  b3184a9
- perf(cq): use exact byte-shuffle lookup
  EMEL Worker
  committed
  2dd76ea
- perf(cq): unroll byte-shuffle dot
  EMEL Worker
  committed
  b3bcd30
- Use packed CQ4 selectors in prepared graph route
  EMEL Worker
  committed
  38e722a
- Revert "Use packed CQ4 selectors in prepared graph route"
  EMEL Worker
  committed
  a7a2f77
- perf(cq): decode sixteen selectors per shuffle group
  EMEL Worker
  committed
  6e0daf8
- perf(cq): prepare exact q4 lookup tables once
  EMEL Worker
  committed
  d0feabb
- perf(cq): add exact input-major16 block route
  EMEL Worker
  committed
  4f36136
- perf(cq): hoist exact group norms
  EMEL Worker
  committed
  1fa43e3
- fix(needle): match reference tokenizer ids
  EMEL Worker
  committed
  8ab1b17
- Optimize CQ4 lookup for 32 selectors
  EMEL Worker
  committed
  619f2db
- perf(cq): use block32 for prepared batch4
  EMEL Worker
  committed
  7e52e38
- perf(cq): vectorize FWHT128 and hoist A8 scale
  EMEL Worker
  committed
  5760a99
- fix(cq): gate AVX2 routes and reject nonfinite A8
  EMEL Worker
  committed
  0ff51ad
- perf(cq): transpose prepared norms for block32
  EMEL Worker
  committed
  c12704d
- test(cq): cover grouped block32 norm storage
  EMEL Worker
  committed
  0d45f0c
Commits on Aug 31, 2026
- feat(needle): profile graph non-CQ phases
  EMEL Worker
  committed
  b226ea6
- perf(zcrms): vectorize row normalization
  EMEL Worker
  committed
  7b1a0ec
- optimize needle SWA for GQA2
  EMEL Worker
  committed
  2812f9a
- fix(swa): harden GQA2 request validation
  EMEL Worker
  committed
  ad83b46
- fix(swa): reject aliased cache writes
  EMEL Worker
  committed
  d77e49c
- Optimize CQ4 raw lookup32 lane ordering
  EMEL Worker
  committed
  6b08fe3
- wip: pause cact needle performance research
  EMEL Worker
  committed
  7304f9a
- perf(cq): fuse raw lookup projection pairs
  EMEL Worker
  committed
  00db128
- Revert "perf(cq): fuse raw lookup projection pairs"
  EMEL Worker
  committed
  704f33f
- optimize needle hadamard with avx2
  EMEL Worker
  committed
  de83708
- optimize cq prepared gemv with block64
  EMEL Worker
  committed
  6fa2ec6
- Optimize Needle SWA exponential pass
  EMEL Worker
  committed
  098df05
- feat(needle): parallelize prepared projection wave
  EMEL Worker
  committed
  f3d1e10
- bench(needle): compare serial and parallel graph routes
  EMEL Worker
  committed
  ae11fbf
- fix needle benchmark fixed-context runs
  EMEL Worker
  committed
  f136394
- Fix portable Hadamard size guards
  EMEL Worker
  committed
  7ff5678
- fix(generator): scope GCC pedantic suppression
  EMEL Worker
  committed
  ab56399
- test(cq): use canonical prepared geometry
  EMEL Worker
  committed
  bdc7536
- test: align Mimi projection diagnostics with host route
  EMEL Worker
  committed
  3e148f2
- fix(swa): preserve generic value accumulation order
  EMEL Worker
  committed
  328b681
- fix(bench): pair needle graph compare cases
  EMEL Worker
  committed
  4b4a06e
Commits on Sep 1, 2026
- test: merge template coverage lines
  EMEL Worker
  committed
  db5c390
- test(speech): cover generator and moshi guards
  EMEL Worker
  committed
  d600d7d
- test(kernel): cover portable aarch64 guards
  EMEL Worker
  committed
  90c35be
- test: cover memory and model state routes
  EMEL Worker
  committed
  f365259
- test(text): cover jinja detokenizer and preprocessors
  EMEL Worker
  committed
  64c079c
- test: cover x86 kernel routes and rejections
  EMEL Worker
  committed
  274ee65
- test(generator): cover layer routes and outcomes
  EMEL Worker
  committed
  8ef4053
- test(needle): cover graph routes and validation
  EMEL Worker
  committed
  d449b2e
- test: correct x86 f16 matmul layout expectations
  EMEL Worker
  committed
  d7c86bd
- Fix Jinja text coverage expectations
  EMEL Worker
  committed
  5cc4573
- test: scope loader boundary source scan
  EMEL Worker
  committed
  cc21b57
- Split coverage runtime shard
  EMEL Worker
  committed
  cae4ec9
- Fix portable libFuzzer runtime detection
  EMEL Worker
  committed
  791ec38
- fix kernel guard overflow validation
  EMEL Worker
  committed
  6543a59
- fix needle graph geometry and dilation
  EMEL Worker
  committed
  0ed1bf3
- maintain decisive Needle evaluator gate
  EMEL Worker
  committed
  7bb2d77
- Validate CAct tensor payload ranges
  EMEL Worker
  committed
  9e20fae
- test: isolate needle AVX2 route preconditions
  EMEL Worker
  committed
  1b3092f
- fix(cq): reject zero groups before padding math
  EMEL Worker
  committed
  2069941
- fix needle engram geometry bounds
  EMEL Worker
  committed
  7b94cc6
- fix needle evaluator input and mmap contracts
  EMEL Worker
  committed
  ef13e1a
- fix(cq): reject non-finite execution scales
  EMEL Worker
  committed
  b10f15d
- fix cact loader span lifecycle
  EMEL Worker
  committed
  ead65e9
- fix needle graph thread construction failure
  EMEL Worker
  committed
  073efb4
- fix needle empty callback dispatch
  EMEL Worker
  committed
  9b2c9f3
- feat(needle-eval): expose activation route
  EMEL Worker
  committed
  e758079
- fix(needle): align heldout quality reference
  EMEL Worker
  committed
  c35c11f
Commits on Sep 2, 2026
- fix: harden Needle runtime review boundaries
  EMEL Worker
  committed
  a3a34bd
- fix: resolve Needle runtime review findings
  EMEL Worker
  committed
  6cd8e44
- Fix parity parser callback noexcept declaration
  EMEL Worker
  committed
  cf949fd
- fix(cq): validate prepared payload once
  EMEL Worker
  committed
  b9dce56
- fix needle request benchmark thread contract
  EMEL Worker
  committed
  0a185d1
- fix(sm): block idle fork join workers
  EMEL Worker
  committed
  c41c7d5
- feat(bench): add live Cactus Needle comparison
  EMEL Worker
  committed
  c674d99
- fix needle reference authentication TOCTOU
  EMEL Worker
  committed
  b1bfa7b
- fix bench needle live snapshot gating
  EMEL Worker
  committed
  ffda862
- Encapsulate prepared CQ publication
  EMEL Worker
  committed
  8186c04
- fix needle authenticated worker reentry
  EMEL Worker
  committed
  8555bc3
- Own prepared CQ payload storage
  EMEL Worker
  committed
  dfed17c
- Bind Needle compare to authenticated Python path
  EMEL Worker
  committed
  085238b
- fix(bench): align Needle request run limits
  EMEL Worker
  committed
  c296064
- Harden prepared CQ publication lifecycle
  EMEL Worker
  committed
  7dce786
- Harden Needle process lifecycle
  EMEL Worker
  committed
  dd6d7dd
- Seal authenticated Needle interpreter execution
  EMEL Worker
  committed
  76bc15b
- Provision sealed exec in reusable bench builds
  EMEL Worker
  committed
  3342a3d
Commits on Sep 3, 2026
- Close sealed interpreter descriptor on exec
  EMEL Worker
  committed
  8a6dd78
- Allow the full authenticated exec environment
  EMEL Worker
  committed
  a21bb4c
- style: format cact needle runtime files
  EMEL Worker
  committed
  265b6bf
- enforce build memory envelope
  EMEL Worker
  committed
  821a973
- enforce envelope at build entrypoints
  EMEL Worker
  committed
  336e443
- verify memory envelope from kernel state
  EMEL Worker
  committed
  e409ab2
- bound builds by ancestor memory limits
  EMEL Worker
  committed
  491f40b
- remove unenveloped build presets
  EMEL Worker
  committed
  db3c7e8
- remove unenveloped test preset
  EMEL Worker
  committed
  7660b73
- envelope standalone quality gates
  EMEL Worker
  committed
  7a4b018
- require verified systemd memory scopes
  EMEL Worker
  committed
  cd08fe4
- envelope profiling entrypoints
  EMEL Worker
  committed
  cfde803
- sync memory contract README template
  EMEL Worker
  committed
  fee2a2b
- remove unsafe help bypass
  EMEL Worker
  committed
  f0d2e6f
- envelope benchmark reference execs
  EMEL Worker
  committed
  51e42fd
- document macOS profiling fail closed
  EMEL Worker
  committed
  5b23d2a
- clarify profiling availability
  EMEL Worker
  committed
  ca7739a
- make memory source test hermetic
  EMEL Worker
  committed
  e301f59
- make memory calculations test portable
  EMEL Worker
  committed
  d0648f6
- fail closed memory command wrapper
  EMEL Worker
  committed
  02366c8
- authenticate hard memory cgroup scopes
  EMEL Worker
  committed
  8623b68
- replace fork join pool with upstream scheduler
  EMEL Worker
  committed
  c8569f8
- fix(deps): advance SML scheduler pin
  EMEL Worker
  committed
  12300c6
- docs: update scheduler integration pin
  EMEL Worker
  committed
  38bbe10
- fix decode wavefront parallel lane routing
  EMEL Worker
  committed
  a5a5a97
- build: pin reviewed SML scheduler fixes
  EMEL Worker
  committed
  a6f1ec0
- Fix decode wavefront pack capture for Clang
  EMEL Worker
  committed
  b0d6ab8
- fix tokenizer vocab reset stack use
  EMEL Worker
  committed
  bc21d1a
- fix: inline tokenizer vocab reset
  EMEL Worker
  committed
  60da9dc
- fix(decode): serialize mutable lane aliases
  EMEL Worker
  committed
  ffefca1
- fix(decode): bound mutable alias admission
  EMEL Worker
  committed
  1bf8b03
- fix(decode): cover graph actor alias extent
  EMEL Worker
  committed
  516ff00
- fix wavefront mutable owner alias guard
  EMEL Worker
  committed
  a7fd218
- docs: close cact needle control plane
  EMEL Worker
  committed
  c06ddc2
- docs: distinguish runtime source head
  EMEL Worker
  committed
  b3391a2
- bench: enforce Needle Cactus envelope parity
  EMEL Worker
  committed
  a3587a3
- feat(needle): add source-owned request runtime
  EMEL Worker
  committed
  dce8ecb
- bench: preserve full Needle envelopes
  EMEL Worker
  committed
  1678d27
- bench: retain Needle package tree identity
  EMEL Worker
  committed
  1064009
- bench: mark closed Cactus request contract noncomparable
  EMEL Worker
  committed
  1a77f83
- bench: disable Cactus telemetry in worker
  EMEL Worker
  committed
  0b1888b
- bench: secure Cactus output and aggregate independently
  EMEL Worker
  committed
  e622eab
- fix needle request validation and lifecycle safety
  EMEL Worker
  committed
  2faddf8
- fix(needle): validate route tool schema structurally
  EMEL Worker
  committed
  d13f2ad
Commits on Sep 4, 2026
- bench: verify Needle request fixture tokens
  EMEL Worker
  committed
  6d64446
- bench: restore Needle EMEL metadata validation
  EMEL Worker
  committed
  7b2949d
- fix(needle): fail illegal request runtime dispatch
  EMEL Worker
  committed
  78fa42b
- Reject EMEL metric metadata collisions
  EMEL Worker
  committed
  93f6e20
- Invalidate Needle outputs on runtime dispatch
  EMEL Worker
  committed
  5cd1570

Commits

Commits on Aug 30, 2026

Commits on Aug 31, 2026

Commits on Sep 1, 2026

Commits on Sep 2, 2026

Commits on Sep 3, 2026