Skip to content

study(shared-stream): separate the stream relationship from the IMU redraw - #308

Merged
Telschow merged 1 commit into
mainfrom
study/streams-only-imu-fixed
Nov 7, 2026
Merged

Telschow merged 1 commit into
mainfrom
study/streams-only-imu-fixed

Conversation

@Telschow

@Telschow Telschow commented Nov 7, 2026

Copy link
Copy Markdown
Owner

Post-remediation audit, CN-AUD-01 / K1. The ten-seed comparison in ADR-0010 changed the IMU draw as well as the vision seed, so it could not isolate the GNSS/visual dependence.

  • New streams_only seeding: the independent vision seed, with the IMU noise pinned to its shared draw for one run. The pin answers the two IMU channels of _derive_seed and is undone afterwards (also after an error). Nothing in src/navkit/degrade changes, no default, no golden, no held-out seed.
  • CSV: six new columns after the original fourteen. The original columns are regenerated by the same code. A fresh run on this machine differs from the committed values by up to about 4e-10 relative, which the study's own compare allows (ADR-0009). Every median on the page is unchanged.
  • Page section and an ADR-0010 follow-up paragraph report the two changes apart. The decision in ADR-0010 is not changed.
  • Result: for every case the streams-only change has the same size and sign as the combined one, so the IMU redraw explains little. outage_control (no vision) equals the shared run.
  • Limits stay: ten development seeds, four cases, medians, not a significance test.
  • Test count floor in metrics.json regenerated (scripts/metrics.py --write); it will conflict trivially with test(seed-policy): inventory every seed flag; guard the shared study runner #305 on merge.

make docs-fast passes, plus ruff and mypy.

🤖 Generated with Claude Code

…edraw (CN-AUD-01)

Adds a streams_only seeding: the independent vision seed with the IMU noise pinned to its shared draw for the
length of one run. The original fourteen columns keep their meaning. The page section and ADR-0010 report the
two changes apart. outage_control, which has no vision, equals the shared run, which the tests check.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Comment thread tests/test_shared_stream_effect.py Dismissed


def test_the_pin_is_undone_after_an_error():
original = sse.inject._derive_seed
@Telschow
Telschow merged commit 1f83107 into main Nov 7, 2026
30 checks passed
@Telschow
Telschow deleted the study/streams-only-imu-fixed branch November 7, 2026 09:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants