Repository navigation
Correct 023: the embedding perturbation explanation is refuted - #120
Merged
Merged
Conversation
…ords refute The result section attributed the T0 to T1 move to frontmatter changing every embedding. recall at 492501c6 strips Markdown frontmatter before chunking, and the surviving session streams show identical queries scoring identically across tiers with matching thresholds. The correction is appended below the frozen marker; no prediction or number above it is edited. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Appends a dated correction to
preregistration/023-corpus-lineage-tiers.md, below the frozen marker. Nothing above it changes, and no number in the existing result is edited.The result section explained the T0 to T1 move (5 harmed to 2) as a retrieval perturbation: writing
valid_frominto all 4,911 documents was said to change every embedding. That explanation is wrong.492501c6(the last master commit before the tiers were built) indexes.mdastext/markdown. It chunks the body with the frontmatter removed and moves the keys into metadata. The embedded context prefix reads only atitle:key.Consequences recorded in the correction
Test plan
tests/test_public_tree.py,tests/test_no_host_inventory.pyandtests/test_prereg.pypass (38 passed).scripts/check_public_tree.pyon the changed file: clean. The private-term check did not run becauseRECALL_PUBLIC_TREE_DENYLISTis not set in this shell.🤖 Generated with Claude Code