Repository navigation
Commit 9f27698
The cold questions have margin: two of the three fourth-place probes reach their page first (#978)
* manual: two cold questions reach their page first instead of fourth, so the floor has margin
MEASURED FIRST, on dev c495991 with the gate green: 8 of the 22 held-out
questions reach their page first, 9 reach it only within the top four, 5 miss,
and the floor is 17 = 8 + 9 exactly. So the floor did not have one thin probe —
it had NINE simultaneously load-bearing ones, and any of the nine slipping out
of fourth place reddens every open pull request. That is what cost four lanes an
evening: #933 lost one question by a hair to a section about a tick's cell, and
the gate reported an aggregate with no per-question ownership, so it took a
bisect to find out which.
Two of the three fourth-place probes are now first:
how do I send it a photo 4th -> 1st attaching-files
how do I tell it which project to work on 4th -> 1st choosing-a-folder
held out first 10/22 -> 12/22 · within top 4 18/22 -> 18/22
the hundred-probe plain table unchanged, nothing lost a place
EACH WAS MEASURED AND ONLY THE FORM THAT MOVED WAS KEPT. attaching-files took
the asker's words into its EXISTING heading and went first. choosing-a-folder
did NOT move that way — the same edit to its heading left it fourth — because
its `/folder` section is four thousand characters and loses on length
normalisation however many of the asker's words the heading carries. A short
section of its own took it first. That is the form #973 proved works, and the
correction it forced on the folklore this repository was passing around: a new
`## ` heading is a HAZARD to be measured, not a prohibition to be obeyed. What
is forbidden is adding one and trusting it.
AND THE NEW SECTION SAYS WHAT THE PAGE SAYS. The first draft claimed the chosen
folder's name is on the status line, which contradicts this page's own law five
hundred lines down — what choosing a folder does is make the conversation ABOUT
it, while where aforge is standing does not move. Corrected before it shipped,
and it points at the section that owns the distinction rather than restating it.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
* docs(changes): number the entry with the pull request it belongs to
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
* docs(changes): the length cap and the retrieval floor are one law, not two
Lane P's reframing of this change's own finding, and it is better than the
finding was. I had written "a long section resists its heading". What is
actually true is that CLAUDE.md's "keep each section under ~2000 characters and
self-contained" IS the retrieval rule: BM25 normalises by length, so a section
past the cap is already hard to reach whatever its heading says. Measured on
this page — the `/folder` section is 3825 characters and would not move to first
place however many of the asker's words its heading carried, while a
600-character section on the same page took the same question to first.
choosing-a-folder.md has nine sections over the cap, up to 5079.
That matters because of WHEN each rule can be followed. "Measure both forms"
only helps somebody who already has a retrieval failure to diagnose. "Keep the
section under two thousand characters" is a rule they can follow while writing,
before anything is red — and it now has a measured reason rather than reading as
a preference about how much prose a person wants at once.
It also gives the choice between the two forms a cheap test instead of
judgement: `wc -c` the section. Under the cap, put the asker's words in the
heading. Over it, split the section — which fixes both laws at once — or write a
short one beside it. Splitting is the better instrument where there is room,
because an over-cap section is a defect on its own terms and not only when a
probe finds it. Not done here: nine sections is its own piece of work.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
* docs(changes): name the section this change checked its claim against
Lane P's proposed shape for the one failure the manual gates cannot catch, tried
here on the change that found the need for it rather than argued about.
CLAUDE.md is explicit that the gates check a name is MENTIONED and never that the
claim around it is true — a tool named in a "what aforge cannot do" section
satisfies them perfectly while lying. It also already obliges a lane landing a
capability to grep the corpus for the old denial. So the honest statement is not
that there is no mechanism; it is that there is a stated obligation with nothing
behind it.
This entry now names the section it checked against. It is not a gate and could
not be made into one cheaply. It is a prompt to do the read, written where a
reviewer can see whether it was done — and the read is what caught this change's
own false sentence, which no test in this repository would have.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>1 parent b429f6b commit 9f27698
3 files changed
Lines changed: 62 additions & 1 deletion
File tree
- docs/changes/unreleased
- internal/manual/chat
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
53 | | - | |
| 53 | + | |
54 | 54 | | |
55 | 55 | | |
56 | 56 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
64 | 64 | | |
65 | 65 | | |
66 | 66 | | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
67 | 83 | | |
68 | 84 | | |
69 | 85 | | |
| |||
0 commit comments