Skip to content

feat: add opt-in per-layer residual diagnostics - #3

Merged
DivyamTalwar merged 1 commit into
mainfrom
codex/residual-diagnostics
Aug 23, 2026
Merged

feat: add opt-in per-layer residual diagnostics#3
DivyamTalwar merged 1 commit into
mainfrom
codex/residual-diagnostics

Conversation

@DivyamTalwar

Copy link
Copy Markdown
Owner

Summary

  • expose realized beta, axis-gain, projection-error, and update-norm metrics
  • collect separate attention/MLP residual reports for every layer
  • keep instrumentation disabled by default to avoid accelerator synchronization overhead
  • verify the beta=1 projection identity, output parity, bounds, and JSON serialization

Acceptance

  • instrumented and uninstrumented logits agree
  • beta stays in [0,2] and |1-beta| stays in [0,1]
  • beta=1 reaches a constant scalar projection target within 1e-5
  • CI must pass before merge

@DivyamTalwar
DivyamTalwar merged commit 8b9a698 into main Aug 23, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant