Skip to content

8D-SonKu: native binaural DSP, studio orbit GUI, smooth motion and headphone FAT - #606

Merged
116 commits merged into
mainfrom
feat/8d-sonku-p0-editor-recovery-20261113
Nov 13, 2026
Merged

116 commits merged into
mainfrom
feat/8d-sonku-p0-editor-recovery-20261113

Conversation

@masarray

@masarray masarray commented Nov 12, 2026 •

Copy link
Copy Markdown
Owner

P0: 8D-SonKu native FX UI is missing after click — integrated recovery

Root cause verified

  1. Original PR feat(8D-SonKu): measured binaural native FX + 360° motion UI (release qualification) #601 stayed unmerged: current public main did not contain SonKu.
  2. The real native WebView2 FX dispatcher had no match for armix.builtin.8d-sonku.v1: accepted inserts were passed to a generic vendor-editor path rather than the native SonKu GUI.

Reconciled, most-advanced source base

This integrated branch starts at PR #604 HEAD 3b2e4f0, ahead of main and including latest contextual GAIN/FX/Sends-on-Faders, approved v9 PNG, and post-#602/#603 packaging changes. It forward-ports SonKu's validated DSP from #601 without reverting those newer changes.

The PR now targets main, so exact-SHA Windows FAT and final integration can be reviewed on one candidate. It includes currently unmerged PR #604 changes by construction. Coordinate #604 as superseded upon acceptance; avoid double-merge or dropping its console changes.

Implementation

  • Exact native built-in catalog identity and openPlugin dispatch to ArSonMixNativeSonKu.open(t,slot), only after accepted FX insert + exact graph readback. No premature/inert editor.
  • Measured MIT KEMAR binaural FIR in the JUCE native processing path, deterministic stereo orbit with controls, persisted state, native edit SPSC with audio-applied ACK and accepted readback. No WebAudio fake PCM.
  • Compact single-source /preview/ head and twin-source orbit UI, within the original 18 FX/CSS owners.
  • Fix overlapping 250ms readback requests so an outstanding DSP snapshot cannot be overwritten before the message-thread reply.
  • Dedicated real Chromium GUI FAT at 1366×768 and 390×844 (native backend transport emulated), including picker click, no popup before ACK, real accepted graph readback, visible editor, close/reopen, edit ACK, screenshot artifacts, and delayed-snapshot regression. Fast g++ measured HRIR test.

Qualification and limits

Actual Chromium editor flow passed on initial source: https://github.com/masarray/arsonmix/actions/runs/43316431872
The latest readback-race hardening requires revalidation. Windows JUCE / installer exact-SHA FAT to run on final head before any user-facing public release. This remains native built-in FX (not separately packaged VST3); room simulation, freeform paths and listener headphone localization are separate future qualifications. Do not claim production hardware FAT or public release until verified.

2026-11-13 SonKu approved head asset and orientation

  • Owner-selected top-view translucent blue bust PNG is bundled from site/preview-v2/assets/sonku-listener-top.png into the single approved /preview/ / JUCE WebView2 editor. The image remains passive (no pointer capture, no JS DSP). Current repo asset is the previously approved 128px optimized raster, displayed at 186×190 logical SVG units; the original source PNG was not overwritten.
  • FRONT is at the BOTTOM, REAR at TOP, anatomical RIGHT at screen LEFT and anatomical LEFT at screen RIGHT. The existing DSP angles remain FRONT=0°, RIGHT=+90°, REAR=180°, LEFT=-90°. Geometry is x=centerX-r*sin(azimuth), y=centerY+r*cos(azimuth), and drag inversion preserves those signs; no audio or HRTF sign changes.
  • Added a dark cyan low-noise halo and secondary radial guide, centered the blue asset and clean glass L/R emitters, kept original 18 CSS owners, and prevented the image from intercepting pointer events.
  • Strengthened real Chromium FAT with SVG textContent+actual label positions, four acoustic poses, and mouse pointer drag from screen-left to bottom FRONT, checking emitted native startAzimuthDegrees≈0 and subsequent ACK/readback.
  • PASS exact SHA 4e1974e9b18e52d8d32b1d5e99b7565df9ae4948: Chromium GUI FAT, desktop + narrow screenshot artifact. Fast UI contracts passed too. The test uses emulated native transport: it verifies the real GUI, NOT physical ASIO acoustics or real-device headphone perception.
  • Release status: PR remains draft and behind advancing main, not shipped to public installer. Reconcile up-to-date main and run exact-SHA native FAT before merge/public release.

2026-11-13 Studio spatial editor UX upgrade

User screenshot review: Original orbit looked flat/circular and disconnected from top-side listener; at 0° Stereo Spread, L/R speaker badges overlapped; control panel looked like a generic HTML web form.

Delivered on this PR after original native fix:

  • One perspective ellipse (screen coordinates Cx=200,Cy=174,Rx=148,Ry=83) with separate rear dashed orbit path painted behind listener PNG and near front highlighted orbit path painted over the bust. FRONT stays bottom, anatomical RIGHT screen-left; DSP HRIR angle signs unchanged.
  • Original small two studio monitor SVGs with woofer/tweeter, distinct cyan/pink channels, accessible slider semantics, and independent pointer targets even when native spread=0°. Coincident acoustic anchors are preserved; small symmetric tangential display displacement plus tether makes the monitor symbols legible without modifying stereo width or source angles.
  • Four tactile studio rotary knobs (time, spread, wet/dry, trim), brushed satin dark finish, compact numeric values; underlying range inputs stay focusable/accessibly keyboard-operated. Vertical pointer motion accumulates draft and commits one typed native edit on release; double click returns defaults.
  • Source-accurate acceptance tests: rear-then-head-then-front paint order; both monitor glyphs at 0° spread; identical native positions; all four headings; real mouse speaker drag to acoustic FRONT; vertical knob one-send native readback; full editor open after insert ACK. Distinct 1366×768 and 390×844 preview screenshots.
  • Official UI influence research only: Sound Particles Energy Panner 2, Waves Nx and dearVR PRO 2. Do not copy skins/assets/code.
  • ARD/PRD/research are updated with exact projection, audio ownership, and repeatable regression criteria.

Verified exact code SHA: 4652a744ab4ae01b1ceca58bb6c3d7e372eb420a — scoped Chromium editor test + Fast UI Contracts PASS: https://github.com/masarray/arsonmix/actions/runs/43342451656. Verified screenshots ZIP.
Docs lock commit: cc6f71d6e1a237a4f04cf431baa3a31666d642d9. Docs-only, no new expensive Windows FAT dispatched.

Not yet shipped: PR still draft and diverged from advancing main. No claim of hardware headphone externalization, validated ASIO field performance, or VST3 standalone release. Reconcile production base and exact-SHA Windows qualification before merge/public installer.

2026-11-13 SonKu native first-sound and exact HEAD qualification

Native audio milestone:

  • Original measured MIT KEMAR 2-emitter headphone convolution now smooths its four HRIR filters on every audio sample (direction targets still recomputed every 16 samples), without adding dynamic callback allocation, second device callback, threads or WebAudio DSP. Filter time 6 ms, wet/trim ramp 8 ms; exact dry after settling.
  • Added PCM fixtures to distinguish abrupt FRONT->REAR edits, buffer-partition parity, nonfinite/clipping protection and clickless wet/trim transitions. The code change is efe883a370e5bcd764bb9049cac0de0eb3cee4c7 + dry-settle fix fdf484a03be88b5c0ddaae5a7ce249e50d446b2d.
  • Added pure C++ offline listening executable tools/sonku_offline_listening.cpp using the same SonKuSpatialCore.h as JUCE. It builds three ORIGINAL source-noise headphone references (no copyrighted music): labeled FRONT/RIGHT/REAR/LEFT, balanced eight-position blind test with separate answer key, and continuous 360° clockwise orbit. Exact audio WAV 48 kHz stereo PCM, test fixtures inspect header, duration, channel energy/orientation and clipping.
  • User-test audio package: https://github.com/masarray/arsonmix/actions/runs/43353557065/artifacts/14004169870 (archive with three .wav files, guide and blind answer key).
  • Current head Chromium GUI screenshots: https://github.com/masarray/arsonmix/actions/runs/43353557065/artifacts/14004677858
  • Current code/merge HEAD 10bf6cad3726bff055fbbfd2f77cf0362e6235dc, merge ancestry includes main@0e3115f0e25334ef34b88ebac77005a849d55db8. This preserves latest native fader, hardware PNG PFL, FX editor, WIRE and CI. GitHub sees 0 commits behind main at this checkpoint.
  • Verified exact-SHA runs: Fast UI C++/contract checks, dedicated SonKu desktop/mobile Chromium editor + actual source-generated WAV, focused native Windows CTest, Logical Mixer C++20, Harmony verification and AUTO PR0: PASS.
  • Not qualified: full Windows application/installer FAT at this head, physical ASIO p95/p99 latency/XRun, human blind front/rear externalization on real headphones, room early reflections/FDN, 88.2/96k sample rates, independently hosted VST3 binary, and public release. Do not call a synthetic WAV/CI green a physical sound-quality certification.
  • A different PR's Windows FAT was active when this head qualified, so no duplicate full MSVC/ZIP FAT was dispatched. Next Windows candidate gate: one exact-head /arsonmix-ci fat after the active build completes, if branch head unchanged and main reconciled.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Nov 12, 2026 •

Copy link
Copy Markdown

Deploying arsonmix with  Cloudflare Pages  Cloudflare Pages

Latest commit: 276701e
Status: ✅  Deploy successful!
Preview URL: https://50201ed4.arsonmix.pages.dev
Branch Preview URL: https://feat-8d-sonku-p0-editor-reco.arsonmix.pages.dev

View logs

Copy link
Copy Markdown
Owner Author

/arsonmix-ci fat 4f4b15e

@masarray
masarray changed the base branch from feat/console-contextual-gain-sof-20261112 to main November 12, 2026 22:09

Copy link
Copy Markdown
Owner Author

/arsonmix-ci fat bd1fbd0

Copy link
Copy Markdown
Owner Author

Owner-approved 2026-11-13 PRD/ARD — now merged to main

The contextual-mixer requirements are now normative in main via #609 (merge 93525087404e63288cffe8383ef0c8f989f3c825):

Do not treat this docs merge as native implementation. The approved workflow is one assembled /preview/ mixer, GAIN/FX RACK interlock, SOF fader-flip for the selected destination, independently selected EdgeId PRE_FADER (post-insert; not browser PRE_FX)/POST_FADER + SEND ON/OFF/level, no wire auto-connect/remove at fader minimum, truthful native installed PCM ACK/readback, retained MUTE/SOLO, pinned MAIN and original approved assets. Keep 8D-SonKu separate from Harmonice (vocal FX) and ArSonMix mixer identity.

Progress preservation: At this checkpoint #606 is the most advanced integrated branch already including #604 contextual GUI work. Refresh main and live PR HEAD before coding/merge; reconcile #609 docs-first and do not double-merge #604 or overwrite SonKu/editor work. Native digital Gain, exact PRE_FADER after FX, send ON, native PCM readback and ASIO FAT are still open acceptance items. Docs-only #609 used no heavy CI.

Replayed two exact public GUI and three V66 motion-contract hunks;
verified patch replay against prior main reproduces byte-for-byte latest main.
Keep both parents and native WebView/PCM work; no force push or release.
reconcile: preserve main V65 WIRE + updater with qualified SOF and SonKu native graph

Copy link
Copy Markdown
Owner Author

/arsonmix-ci native b2810b5

Copy link
Copy Markdown
Owner Author

2026-11-13 — cross-branch native SOF/SonKu + V66 WIRE + M4 updater reconciliation checkpoint

PR #640 was merged into #606 (real Playwright native WebView SOF/EdgeId ACK + readback). Its first dedicated Chromium qualification 43376269774 PASSED and produced desktop/narrow screenshots.

PR #642 was merged into #606 at exact b2810b51d68a5cb2bf0a93fc92853e6bd8e30be0, preserving both Git histories via validated two-parent main merge commits. Main has advanced from the original #606 base to V66 WIRE 1f77b89f8f78eb2475322170546a6dce47ef2557 with V61..V66 OUT waves/retraction, and M4 updater 7232c1e... + installer last-mile checks a6b8a3f....

Reconciliation proof:

Copy link
Copy Markdown
Owner Author

2026-11-13 — native WIRE Inspector rejection/no-op recovery merged, zero new Windows compilation

Implemented and merged #648 into this draft branch. New exact #606 HEAD: 276701e93447602b3e3573bcd815736fb812899e (main V66 remains preserved; 116 ahead/0 behind at latest compare).

Operator bug: native WIRE Inspector could keep showing PENDING · requested dB indefinitely after a rejected/expired SET_WIRE_GAIN, a dropped stale EdgeId, or a suppressed exact same-value gain no-op. This was a GUI authority bug, not evidence of changed PCM audio. Fixed in the native-only GUI assembly and bridge:

  • A single nativeWireGainReadback(current) derives one canonical readout from accepted native PCM EdgeId + gainLinear. No extra subscriptions/timers/polling or different DSP graph.
  • Rejection/timeout uses controller's still-admitted state.current to roll back the original focused inspector input in place to UNCHANGED · accepted dB, or SEND UNAVAILABLE if the exact edge is gone; no mistaken routing edit or new snapshot required.
  • Deferred gain coalescer also settles exact no-ops without an invented ACK and refuses replay on changed graph/device identity.
  • Native failure rendering now respects focused #wireWsGain, so keyboard/pointer input is not detached.
  • Public site/preview-v2/index.html remains byte unchanged. Native engine/DSP/JUCE audio callback unchanged.

Evidence:

External workflow reference checked: Yamaha DM7 and Allen & Heath Avantis both treat SEND LEVEL, SEND ON/OFF and PRE/POST as independent send-owned controls. Native still applies actual changes only after ACK and independent PCM readback.

Do not ship/public-merge automatically: #606 remains draft pending physical ASIO+VST3 monitoring FAT and optional owner-authorized package validation. #614/#629 separate drafts not blindly merged.

Copy link
Copy Markdown
Owner Author

Integrated SonKu consolidation checkpoint — 2026-11-13

The acoustic/native stack is now reconciled into PR #649, an integrated draft based on current main. Its two-parent merge carries this PR's history and the latest #606 native/GUI/updater/WIRE parent simultaneously. Please do not merge this older stacked PR independently into main, or queue redundant Windows builds: the canonical combined qualification now belongs to #649, after which old drafts can be closed as superseded.

Preserved: approved Square Orbit checkpoint 3a74b0273c7a7e13d5d2614183d19995eb12ad57, 8-line FDN, fixed ring/no-RT-clear behavior, source-distance + room models, typed native SPACE controls, schema v2 session restore, real Chromium ACK/readback and musical A/B WAV. All remain pending actual Windows/ASIO and listener release gates.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant