Skip to content

certify: tables-cpp-release after the message form (#549) - #552

Merged
gafferongames merged 1 commit into
mainfrom
certify-tables-cpp-release-blob-node
Sep 5, 2026
Merged

gafferongames merged 1 commit into
mainfrom
certify-tables-cpp-release-blob-node

Conversation

@gafferongames

Copy link
Copy Markdown
Contributor

Certification on main at ddd9c2d0 was red in exactly one job, release-gates (tables-cpp-release). That leg is make tables-wire-fuzz N=500000 twice, at the default seed and at seed 2, and both the seed and the corpus are fixed, so the red is deterministic and reproduces locally at once:

harness: FAILED after 434519 mutants: the report differs:
  the leg says 2,0,0,0,true,read, the oracle says 1,1,0,0,true,read
  corpus seed graph_tree_message (graphdemo.Scene), pass random #331171, run seed 24845619678

The cause

The mutant's node record claims the RESERVED *string type id, and graphdemo has no *bytes and no *string edge anywhere below Scene.

The C++ reference already read that the way §2.5 states it. SceneNodeStorage names a reserved id only where reachableBlobs found the edge, so the record commands no region storage, its body is skipped by its length, and one unknown is counted. The engine named both reserved ids at every root unconditionally, placed a blob node, and the *TreeNode slot that then reached it counted a kind_mismatch on top: two unknown against one unknown and one kind mismatch.

THE MESSAGE FORM IS WHAT MADE IT REACHABLE, exactly as it made message_node_type_unpointed reachable one grain up in #549. A file's trailer carries only the ids its own body used, so a file can never spell this record. §3.3's tail announces bytes and string whether or not the root names them, so a connection's table can.

The fix

ir.PointerReachableBlobs is the companion to ir.PointerReachable and the same walk the emitter's own reachableBlobs already runs. The engine's node table gates its two reserved ids on it, and an id it does not hold falls through to the table lookup and is counted unknown there.

The control

message_blob_node_unpointed is pinned into the corpus as a seed, and make tables-wire-fuzz-blob-node-negative-control reverts the gate through a Go build overlay, so nothing tracked is written. Red, on the vector and not merely somewhere:

harness: FAILED after 103348 mutants: the report differs:
  the leg says 2,0,0,0,true,read, the oracle says 1,1,0,0,true,read
  corpus seed message_blob_node_unpointed (graphdemo.Scene), pass vector #0
negative control: naming a blob node no pointer reaches turns the pinned vector RED

Green

make tables-cpp-release, all four runs, plain and sanitized, at both seeds:

wire-fuzz: seed 24845619678, 115 seeds over 34 roots, 103349 enumerated + 500000 random = 603349 mutants, 0 divergences
wire-fuzz: seed 2,           115 seeds over 34 roots, 103349 enumerated + 500000 random = 603349 mutants, 0 divergences

§2.5's sentence says ROOT rather than reader now, because "a reader that has no blobs" reads as a property of the build where it is a property of the root.

🤖 Generated with Claude Code

…t place (#530)

The C++ release gate went red on main at ddd9c2d, at mutant 434519 of seed
24845619678 over graph_tree_message: the leg reported two unknown, the engine
reported one unknown and one kind_mismatch.

The record claims the RESERVED `*string` id, and graphdemo has no `*bytes` and
no `*string` edge anywhere. The reference already read that the way §2.5 states
it: <Root>NodeStorage names a reserved id only where reachableBlobs found the
edge, so the record commands no storage, its body is skipped, and one unknown
is counted. The engine named both reserved ids at every root, placed a blob,
and the `*TreeNode` slot that reached it counted a kind_mismatch on top.

THE MESSAGE FORM IS WHAT MADE IT REACHABLE, exactly as it made
message_node_type_unpointed reachable one grain up: a file's trailer carries
only the ids its own body used, and §3.3's tail announces `bytes` and `string`
whether or not the root names them.

ir.PointerReachableBlobs is that walk, the companion to ir.PointerReachable and
the same shape as the emitter's own reachableBlobs, and the engine's node table
gates its two reserved ids on it.

Beside the fix, the pinned vector message_blob_node_unpointed and its negative
control: both reserved ids nameable again through a build overlay, and the run
must go red ON THE VECTOR.

And §2.5's sentence says root rather than reader, because "a reader that has no
blobs" reads as a property of the build where it is a property of the root.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@gafferongames
gafferongames merged commit 1436c3f into main Sep 5, 2026
20 checks passed
@gafferongames
gafferongames deleted the certify-tables-cpp-release-blob-node branch September 5, 2026 04:50
rowan-claude pushed a commit that referenced this pull request Sep 6, 2026
…the root's (#557)

tables-cpp-release went red at mutant 280820 of seed 24845619678 over
graph_tree_message, once the harness verdict fix let the pass get past the
earlier red. The mutant's third node record claims the reserved `*string` id
under graphdemo's Scene, which reaches no blob edge at all.

THE TWO ENGINES FRAMED IT DIFFERENTLY. The C++ reference reads the record's
thirty-two bit length by the type id alone, finds 3,739,746,528 bytes in a 66
byte batch, and refuses to measure. The oracle built its blob set from
ir.PointerReachableBlobs and so had no blob ids at all for this root, framed
the record as a TABLE BODY, read its bytes as fields and reported a clean read
with one unknown.

The reference is right and the page now says why. A record's FRAMING is its
type id's: the reserved blob ids say a length, an align and the bytes wherever
they appear, and every reader knows that by the id alone because §3.3's tail
announces all three whether or not a root names them. Its PLACEMENT is the
root's, asked second of the blob edges its pointers reach (§2.5), and a root
that reaches none commands no storage, counts one unknown at the record, and
reads null through every reference to it. Gating the framing on the second
question makes a reader read a blob record's bytes as fields, because a bit
stream carries no length for it to step the record over by instead.

message_blob_node_unpointed is pinned again, at the 66 bytes the pass found,
with tables-wire-fuzz-blob-node-negative-control beside it. #552 pinned this
class and its vector stopped reproducing when the second round moved the
bodies to bits; 4822165 removed both and reasoned that the reader never
places a blob, which is true and was not the divergence. The sabotage is the
one line that gates the framing on reachability again, and the run goes red on
the vector.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
gafferongames added a commit that referenced this pull request Sep 6, 2026
#530) (#557)

* wire: the message form's second round in the engine — the batch and the bitpacked body (#530)

The primitive is a NUMBER OF MESSAGES. EncodeMessages writes one buffer: the
form byte, the count, and the bodies as one continuous bit stream with no
alignment between them, padded to a byte at the end and nowhere else. A single
message is the batch of one, which is the only sense in which this wire carries
one.

And the body is BITPACKED. References ride in bits_required(entries), there is
no kind byte at all, values ride at their declared widths as the packet wire
writes them, lengths ride in bits_required(N), and elision is unchanged.

What a reader needs to skip an id it cannot name is therefore not on the body:
it is the ANNOUNCEMENT's per-entry RECORD, a fixed-stride array under a third
reserved id, carrying the kind, the two widths and the range base each slot
spells. The record is the WIRE CONTRACT for its id and both halves write to it,
so one field name declared at two bounds in two records rides at the widest of
them rather than at either.

The measurements, against the byte body #549 landed:

  login_full      106 file    58 byte body    51 bitpacked   49 proto3
  match_full      273 file   225 byte body   143 bitpacked  189 proto3
  store_full      104 file    48 byte body    41 bitpacked   40 proto3
  login_default    10 file     2 byte body     3 bitpacked
  match_default    43 file    27 byte body    10 bitpacked   40 proto3
  store_default    10 file     2 byte body     3 bitpacked
  the three as ONE BATCH                     230 bitpacked

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* tool: pack and unpack over the message form's BATCH (#530)

`pack --message` writes a batch and `unpack --announce` reads one, because the
primitive is a number of messages and a single message is the batch of one.
`--batch <Table>=<tree-dir>` names each message after the first, in the order it
rides: which root a message is, is the application's, so the tool asks rather
than guessing.

The two verbs' single-message spellings are unchanged and are now the batch of
one, and `unpack` refuses a batch whose count is not the number of roots named
rather than writing a tree it cannot fill.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the C++ reference's bitpacked message codec and its batch (#530)

The bit stream first: a TableBitWriter and a TableBitReader in the packet
wire's own layout, bit i in byte i/8 low bit first, with a bit LEB128 beside
them for the numbers no declaration bounds.

Then the per-entry RECORD the announcement now carries, borrowed from its bytes
like the entries: a fixed-stride array a reader indexes rather than searches,
and one generic TableMessageSkip over it, because a record says everything a
skipper needs and one function then serves every table.

Then the codec: <T>MeasureMessageBody, <T>SaveMessageBody and
<T>LoadMessageBody per table, and the batch's own surface per root —
MeasureMessages, SaveMessages and LoadMessages beside the batch-of-one
spellings. Every reference is a compile-time SLOT and every width a literal on
the write side, so a save does no lookup at all.

AnnounceRead gains the second strict check: the records present, exactly once,
at kind 12, one record an entry. A table with no records is a table nothing can
be read against.

The C++ reference and the compiler's engine agree BYTE FOR BYTE, and measure
equals save, on all eight value-class message vectors of the corpus:

  login_full     106 file  ->  51    match_full  273 file -> 143
  login_default   10 file  ->   3    match_default 43 file ->  10
  store_full     104 file  ->  41    vocab_low    24 file ->   8
  store_default   10 file  ->   3    vocab_wide  192 file ->  68

WHAT IT CARRIES TODAY is the value class with no map. A pointered message and a
map's cursor both take a resolution context this codec does not thread, and a
root whose closure it cannot carry gets no message entry points at all rather
than half of one.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the engine follows the page — entries with shapes, the batch's count, the align (#530)

The page (#523) settles the wire, and this is the engine reworked onto it,
where it is more specific than the brief was.

THE VOCABULARY IS A FIELD of the announcement's body, not its trailer, and an
entry is a TRIPLE: an id, a kind, and a SHAPE. That buys three things the
brief's fixed-stride records could not. §3's writer rule that an id no body
references is never written is restored unbroken. An entry carries the widths
and the RANGE a reader needs to decode a field whose declaration has MOVED, so
every evolution row of §4 stands under a bitpacked body. And ONE NAME MAY TAKE
TWO SLOTS, at two kinds or two shapes, so a unit declaring `count uint8` in one
table and `count uint32` in another needs no canonical widening and no
ambiguity rule at all.

The rest of the page's wire, exactly: the count is a ranged integer over
[1, 256] carrying M - 1, a batch of zero is not spellable, a `string(N)` and a
`bytes(N)` ALIGN before their bytes, a fixed array spends NO count because its
min equals its max, a compressed float rides QUANTIZED as the packet wire
writes it, a pointer index is bits_required(0, node count) and the node table
is the root body's FIRST field, the trailing pad is verified zero, and damage
is TERMINAL for the batch.

The engine now reproduces the page's hand-worked arithmetic exactly:

  login_full     106 file -> 51    match_full   273 file -> 142
  login_default   10 file ->  3    match_default 43 file ->  10
  store_full     104 file -> 41    store_default 10 file ->   3
  the three as one batch -> 230    graph_tree   232 file ->  66
  vocab_low       24 file ->  8    vocab_wide   192 file ->  68
  the announcement: 28 entries, 273 bytes of them, 316 bytes whole

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the message form's second round, resumed from the builder's tree (#530)

The uncommitted tree the previous builder left at 70d44af, measured, built
and committed as it stood: the Go engine builds, the conformance harness is
green on every message row, and the C++ tables test builds and passes.

What it carries: the variable class on the message wire in C++ (the node
table as the root body's first field, thirty-two bit counts, blob records
with a length and an align, index widths settled per body, maps carved from
the framing), the batch's three verbs over a region with one region per
batch, wstring at sixteen bits a unit and the escape kind, the batch's five
answers with batch_too_large on both sides, the wrong-sort rule for variant
and arm references with the reserved-id rule outranking it, the three
reserved ids refused in the vocabulary, the vocab9demo unit for a nine-bit
reference, the fuzzer's bit-level reference pass, schema unpack printing an
announcement, and the sabotage tool's message overlays for every harness row.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* generated: the bench tables unit regenerated, the message codec on its header (#530)

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the fixed body's index width, the sized-through-damage batch, and the fuzz legs at the wire's M (#530)

Resumed from the previous builder's working tree, unchanged in intent.

A FIXED root numbers no node, so the index width it hands its body is zero
rather than a constant the body invents: LoadMessageBody takes index_bits on
both the fixed and the variable path, and a kind-17 entry inside a fixed body
is damage because there is no width to step it over. The Go reader matches by
setting the width to zero at a fixed root and refusing an index read at width
zero.

A ROOT body whose own framing gives out is damage inside that body, not a
whole-batch refusal: the scan answers the bodies up to and including it, and
MeasureMessages sizes through it and no further, which is the region the load
needs to deliver the bodies before the damage.

The fuzz legs hold room for the wire's M so a capacity refusal is never the
answer under fuzz, and the region check rejects a negative byte count before
memset.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the message form's node carve never outlives the frame that owns it (#530)

A record's extent cursor is a local of NodeMessageBody, and the node map it
was published through is the caller's, so a return with the map still naming
it leaves an address the caller could read. The dispatch answers into a bool
and the cursor is restored on the way out.

gcc 13 on the big-endian leg names this exactly, -Werror=dangling-pointer at
the message node body, and the fix is the escape rather than the flag.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* generated: the bench tables unit on the merged compiler (#530)

The committed tree is what this branch's compiler emits: the message codec's
node carve restored on the way out, and main's extent names.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* goldens: the 27 C++ Table pins re-taken on the bitpacked message codec (#530)

WHAT THE GATE ASSERTS is the BLOCK form's zero cost, in three parts: no Table
source carries one block symbol, the C# Table sources carry no build version,
and the frozen Table pins are byte-identical. The first two are the property
and both stand untouched. The third is a golden, and the gate's own text says
a golden is re-pinned when a TABLE emitter legitimately changes.

The message codec is such a change and it reaches EVERY unit, because the
three message verbs are in tableGeneratedVerbs and every table carries them
(§3.3). Every unit's header moves for the same two reasons: `batch_too_large`
joins the refusal reasons, and TableIds loses the `vocabulary` flag and its
two-argument `ref` because a bitpacked body names no id at all — its
references are compile-time slots of the announced vocabulary, so the
byte-framed form's shared id table has nothing left to do. That is the byte
body being replaced in place, which §3.3 states.

The C# and C Table goldens do NOT move, which is the check that the change
reached only the C++ reference: the eight ports carry the file form alone.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the quantizer's integer clamp reads as one, and the cost rows get a harness (#530)

The clamp of the rounded index to `count` is the packet wire's own last step
and is the same answer written shorter, which is what the lint asks for. The
float clamp above it keeps its negated comparisons, because those are what
send a NaN to zero rather than through.

`make tables-message-cost` measures what the page holds the form to: the
bytes each form spends over the three backend messages and the batch, and the
read and write factor the bitpacked body takes against the byte-framed body
over the same values. It is a measurement and not a gate, so it is not in
`test` — a ratio moves with the machine.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* bench: the cost harness comes back out of the tree (#530)

THE ESTATE HAS ONE BENCHMARK and the shape gate holds that mechanically: no
timing primitive outside the sanctioned runner and tool directories. A
hand-written harness under test/ is exactly the divergence class the rule
names, and the gate refused it by name.

The number the cost rule owes is taken off-tree for now and quoted in the PR
body with its sitting. Its reproducible home is the sanctioned bench, a
message-form arm beside the tolerant-wire arm in bench/tables, which needs a
pinned message variant corpus and a row in the per-language board and is
therefore its own change.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the bit stream moves a byte at a time, and the align buys its memcpy (#530)

MEASURED FIRST. On the three backend messages and the batch, the bitpacked
body was writing at 7.9x to 11.6x the byte-framed body's time and reading at
4.2x to 6.2x, against the factor of TWO the page holds the form to. The cause
was in the primitive rather than in the codec: put and get walked ONE BIT at a
time with a division and a modulo per bit, and putbytes spent eight such
iterations per byte on the largest payload the wire carries.

§3.3 already says what the align is for: a string(N), a bytes(N) and a blob
record align before their bytes so the payload moves as one memcpy. It now
does. put and get take the bits that fall in a byte together, so a 64-bit
field costs nine touches rather than sixty-four and no division at all, and
align spends its pad in one call.

THE BITS ON THE WIRE DO NOT MOVE — bit i in byte i/8 at position i%8, low bit
first — and every pinned golden is the proof: the corpus, the round trips and
the batch vectors all reproduce byte for byte.

After: write 1.27x to 2.11x, read 2.05x to 3.54x. The write path is inside
the rule and the read path is not yet; the measurement and the cause are in
the PR body.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* generated: the bench tables unit on the byte-at-a-time bit stream (#530)

The committed tree is what this branch's compiler emits.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the receiver resolves once, into the caller's storage, and the bit stream moves a word at a time (#530)

docs/SPEC-TABLES.md §3.3 says THE RECEIVER RESOLVES ONCE: it reads the
announcement, resolves every entry against its own descriptors, and every body
after it dispatches through one array index. The reader did not. It kept the
OFFSET of each entry inside the announcement's bytes and re-parsed the entry, a
LEB128 shape decode, on every field of every body. That is the code failing the
page, and it is why the read factor sat above the page's bound.

THE STORAGE SHAPE IS WHAT THE SENTENCE NEEDED, and the page states it as a rule
now. The announcement is delivered once and holds for the connection's life, so
the resolved vocabulary lives with the CONNECTION and not with a read call:
the caller declares an array of resolved entries wherever it wants it, hands it
to AnnounceRead with its CAPACITY, and passes it by pointer to every read after
that. Nothing in the codec allocates. THE ENTRY BOUND IS THAT CAPACITY, so an
announcement above it is refused by name as vocabulary_too_large before an
entry is touched, and kTableMessageEntriesHere gives the unit's own entry count
for a receiver that talks only to peers of its own schema. 4096 stays the
conforming default where storage is grown rather than declared.

A RESOLVED ENTRY IS 96 BYTES: the id, the kind, the packing, the payload's
width ALREADY RESOLVED out of the kind and the announced bits, the range base,
the array bounds, and the quantized facts SPEC.md §4.3's rule leaves behind
rather than the two it consumes. TableVocabulary went from 16 KB of offsets by
value to 56 bytes, and the backenddemo unit's 33 entries take 3,168 bytes.
Per field on the read path that is one array index, no parse and no branch.

AND THE BIT STREAM MOVES A WORD AT A TIME, which is what remained once the
vocabulary was resolved: the stream walked one BYTE at a time, so a bare uint64
cost nine masked read-modify-writes to write and nine dependent loads to read,
and MatchResult carries eleven of them. A value of any width now moves in one
unaligned load or store, assembled little-end-first whatever order the host is
in, with the byte walk kept for a value inside nine bytes of the buffer's end.
put still writes EXACTLY the bytes the value occupies, so a caller's buffer
beyond the batch is still its own.

THE BITS ON THE WIRE DID NOT MOVE. Every pinned form-2 golden holds, and the
31 C++ Table pins that re-pin here move for the emitter's own text.

The cost rule is met on both paths, and the sitting is on the page beside the
factor it is held to: write 0.71x to 0.90x and read 1.56x to 1.77x against the
byte body, where head measured 1.54x to 1.95x and 2.44x to 3.52x on the same
sitting.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: a batch's node count sizes nothing until the bits back it (#530)

The message form's node table read reserved its record slice from the
count it had just read off the wire. That count is a thirty-two bit
number off hostile bytes, so a mutated batch commanded gigabytes before
a single record had been read, which is the opposite of what §3.1 means
by load is a scan. The file form already had the discipline: decode.go
checks its count against the bytes it holds before it allocates.

The reservation is now the smaller of the claim and what the stream can
carry, a record costing at least its type reference. bitReader.left
reports the bits still unread, which is the bound.

The wire fuzzer is what this cost. At the N make test runs, the harness
peaked at 10.7 GB and was killed for memory before it finished. It now
peaks at 158 MB and runs at 19,000 mutants a second where it managed
5,000, so the pass is both survivable and three times deeper.

The placeable set is named on its own line here too, as the file
reader names its own, because it is the seam the node-type negative
control replaces.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* tables: tables-vocab-schema compares the whole file, header included (#530)

The target could not pass as written. The generator echoes its own --out
into the file's second line, so generating into build/vocabgen and
comparing against tables/vocab differed on that line by construction,
whatever else matched.

The generator now runs from build/vocabgen under the committed file's
own relative path, so the --out it sees is the --out the committed file
carries. cmp then compares the whole file, and the regenerate line in
the committed header is checked by the same comparison as the tables
below it. Rewriting that line in the committed file turns the target
red, which it could not do before.

This is the smaller of the two fixes. The other was to make the header
path independent, which would have meant teaching the generator a
canonical destination it does not otherwise need.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* certify: the node-type control points at the reader that carries the rule (#530)

Two negative controls could not go red. Both sabotaged
internal/tablewire/decodenodes.go, which is the FILE reader, while the
vectors they assert on are message vectors. The message form's second
round built the placeable set a second time, in messagedecode.go, and
that is the copy a message vector decodes through, so the sabotage
patched a file the vectors never touch: 111,269 mutants, 0 divergences,
and the vector replayed alone gave 0 as well.

The node-type control now sabotages messagedecode.go. It also asserts by
replaying the pinned vector rather than by running the corpus, because
the pinned vectors ride last: an enumerated mutant of an ordinary message
seed reaches the same check, so a corpus pass goes red before the vector
is ever fed and names the mutant instead of the property. With the
sabotage the replay reports

  the report differs: the leg says 1,0,0,0,false,read,
  the oracle says 3,1,0,0,false,read

and without it the same replay is 1 mutant, 0 divergences.

The vector itself was re-derived. The second round moved the message
bodies to a packed bit stream, so every message wire in testdata was
regenerated and the old 104 byte vector stopped being a wire at all. The
new one is 66 bytes, a mutant of graph_tree_message that the reader with
ir.PointerReachable and the reader without answer differently.

THE BLOB NODE CONTROL IS GONE, and its vector with it, removed by
accident in the previous commit and explained here. Under the bitpacked
body a blob record carries a thirty-two bit length that must fit the
batch's remaining bits. A mutated record does name a reserved blob id,
reached at random mutant 11993 of the default seed, and the reader still
never places a blob: over 2,111,269 mutants with both reserved ids forced
nameable, a placement never happened once. The rule stays gated by
ir.PointerReachableBlobs in the reference emitter's NodeStorage and in
the oracle, and the node-type control above covers the same rule at the
ids that are not reserved, which the corpus does reach.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the four rules the cold read found unheld (#557)

A reader of docs/SPEC-TABLES.md §3.3 against the engine found four rules the
page states and neither engine enforced. Each lands with the vector that
shows it and a control that removes the rule.

A QUANTIZED INDEX ABOVE `count` IS REJECTED. The page says so three times and
names the vector, ten bits spelling 1023 over a count of 1000, and both
engines clamped it instead, which is the ranged offset's reconstruct-and-clamp
rule reaching a kind it does not govern. The float's rule is the packet wire's
bit for bit, and the packet wire rejects there.

AN ANNOUNCED MAX IS BOUNDED BY WHAT ITS KIND CAN HOLD. The ceiling was
INT32_MAX in the checker and nothing on the wire, so a 63-bit length width
reached signed overflow in the skip's `n * 8`. A string and a wide string are
bounded by the int32 storage cap the checker applies to every N, and an array
and a keyed entry by the 32-bit count an unbounded array announces, which is
the widest count this form spells.

A COUNT IS BOUNDED WHILE IT IS STILL WIDE, which is M6's discipline over a
count rather than a value. The C++ array and text reads narrowed to int32
first, so a count at or above 2^31 was negative, passed the signed test
against the bound untouched, decoded every element into scratch and landed a
negative count in the caller's storage.

A FIXED-WIDTH ELEMENT'S RUN IS ARITHMETIC. The page already says the surplus
of a fixed-width element is the surplus count times the element's width, and
that nothing in this form is superlinear in a batch's length. Both engines
looped, and a ranged element whose min equals its max rides no bits at all, so
six bytes of wire bought two billion iterations. The skip, the decode, the
extent walk and the Go array now step a fixed-width run in one guarded
multiplication and walk only an element that RESOLVES something, because a
resolve that contradicts its position is damage the reader must still find.
An unbounded array's count is bounded by the bits at one bit an element, the
node table's own discipline.

Four controls: message-max-above-int32, message-quantized-index-above-count
and message-surplus-walked in MESSAGE_FORM_CONTROLS, and the count's own,
message-emitter-narrow-count-before-clamp, as an emitter control over a new
instrument, because no pinned vector reaches a count at 2^31 and nothing about
that body is ill-formed for a refusal to fire on.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: a batch reader's report sink is its own, and a measure refusal is compared as one (#557)

TWO THINGS THE COLD READ FOUND OUTSIDE THE FOUR RULES.

TableMessageBatchOpen wrote a caller that passed no report into a `static
TableReport`, which is shared mutable state: two threads opening two batches
without reports would write one object. It is a member of the batch reader
now, which is what LoadMessages already does with its own local sink.

AND THE WIRE FUZZER'S VERDICT ON A MEASURE REFUSAL. tables-cpp-release went
red at N=500000 on a mutant claiming 129 bodies in a 66-byte wire: the C++
LoadMeasure refused with no counter moved, and the Go oracle decoded body one
and counted one malformed. Both are the page: a LoadMeasure refusal moves no
counter (§6.5), and the fields decoded before the damage stand with the
counters they earned (§3.3). The two sentences govern two operations and both
stand, so the defect is the harness comparing a leg's MEASURE refusal against
the oracle's DECODE by counter tuple. Its own comment already said the oracle
need only agree there was nothing to read on that branch, and the code now
does what the comment says: the refusal verdict is compared, the tuples are
not. The page is unchanged.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: five rules the page was silent on, decided in both engines (#557)

THE COLD READ ASKED FIVE QUESTIONS THE PAGE DID NOT ANSWER. Each is ruled
here, held by both engines, and written on the page.

A FAILED STRICT CHECK IS DAMAGE, NOT A REFUSAL. The announcement's two checks
are the two facts its body must carry, so a build version that is absent,
doubled, under another kind or not eight bytes wide, and a vocabulary that is
absent, doubled or not a run of bytes, each say the bytes are not an
announcement rather than that this peer declined to announce. `no_vocabulary`
is left to what it names, a BODY from a peer that never announced.

THE BUILD VERSION IS KEPT THE MOMENT IT IS READ, refusal or not, so a refusal
on that connection names it, which is what the page already promised and only
the Go refusal struct carried. It is not the vocabulary, and a refused
announcement still sets none.

TWO ENTRIES THAT AGREE ON ALL THREE PARTS ARE MALFORMED. The page said so and
neither engine enforced it. Both do now, at AnnounceRead: the scan is
quadratic in an entry count bounded at 4096, on a path that runs once a
connection.

AN ELEMENT KIND OF 12 OR 33 IN AN ANNOUNCED ARRAY OR KEYED SHAPE IS MALFORMED
AT THE ANNOUNCEMENT. No declaration this language accepts is an array of
`string(N)` or of `wstring(N)`, so the shape is refused once where it is read
rather than accepted there and refused again by the skip that would meet it.

A VARIANT REFERENCE IS RESOLVED ON THE SKIP PATH TOO. Every reference above E
is damage and one naming an entry that carries a payload contradicts the
position it was used in, whether or not this reader was going to keep the
value: it is the next bit's meaning that is in doubt and not the value's. The
three skip paths resolve it, and the fixed-width run that skips a fixed
element by arithmetic excludes every element that RESOLVES something.

AND THE MEASUREMENT ARM IS NAMED FOR WHAT IT IS. The cost rule measured
against the byte body, which this section replaced and which is no longer in
the tree; the arm actually measured is the file form's Save and Load, whose
save interns ids at run time and whose load parses a trailer. The rule and the
measurement table now say the file form on both paths, and the sentence
attributing the sub-1 write factor to bit framing against byte framing is
gone: a write factor below one is a fact about those two programs.

Four controls: message-strict-check-refuses, message-duplicate-entry-accepted,
message-array-of-text-accepted and message-skipped-variant-unresolved.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* docs: present-state comments, dead parameters gone, and no em dashes in this section's prose (#557)

THE COMMENTS THAT DESCRIBED A TREE THAT MOVED. internal/tablewire/message.go
called a form-2 wire TWO PARTS when it is three, said the receiver closes the
connection on a second announcement when the library returns a refusal and the
application decides, described the vocabulary bound as a trailer count when
the vocabulary is a field and the bound is two numbers, and numbered the
announcement's two reserved ids as slots 1 and 2 when they are its transport
and take no slot at all. Each now says what the tree does.

AND TWO ON THE PAGE. The full byte table called the byte-body column the wire
the tree carries today; it is the size the wire that held form byte 2 before
this section would have written, and the codec change this section lands
removed it. The form-byte paragraph said the goldens are re-pinned by a change
that lands; they are re-pinned, by a change that landed.

DEAD PARAMETERS AND A PERMANENT SKIP. bitDecoder.body took a `nested` flag no
branch read, tableMessageForm took a forceInline it never used, and the strict
checks test bound a `version` it never compared, each kept alive with `_ =`.
All three are gone. TestRetentionAcrossTheForms was a permanent t.Skip for a
row that lands with retention (§6.6, schema#525), which is not built in any
language: the test is deleted and the page's row says the suite carries no
test for it yet and no skipped one either.

AND THE EM DASHES. Seventy-six of them in the Go comments, the emitted C++
comments and the page prose this branch adds, rewritten as plain sentences.
The goldens move with the emitted comments, which is what re-pins the hundred
Table sources here.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: a node record's framing is its type id's, and its placement is the root's (#557)

tables-cpp-release went red at mutant 280820 of seed 24845619678 over
graph_tree_message, once the harness verdict fix let the pass get past the
earlier red. The mutant's third node record claims the reserved `*string` id
under graphdemo's Scene, which reaches no blob edge at all.

THE TWO ENGINES FRAMED IT DIFFERENTLY. The C++ reference reads the record's
thirty-two bit length by the type id alone, finds 3,739,746,528 bytes in a 66
byte batch, and refuses to measure. The oracle built its blob set from
ir.PointerReachableBlobs and so had no blob ids at all for this root, framed
the record as a TABLE BODY, read its bytes as fields and reported a clean read
with one unknown.

The reference is right and the page now says why. A record's FRAMING is its
type id's: the reserved blob ids say a length, an align and the bytes wherever
they appear, and every reader knows that by the id alone because §3.3's tail
announces all three whether or not a root names them. Its PLACEMENT is the
root's, asked second of the blob edges its pointers reach (§2.5), and a root
that reaches none commands no storage, counts one unknown at the record, and
reads null through every reference to it. Gating the framing on the second
question makes a reader read a blob record's bytes as fields, because a bit
stream carries no length for it to step the record over by instead.

message_blob_node_unpointed is pinned again, at the 66 bytes the pass found,
with tables-wire-fuzz-blob-node-negative-control beside it. #552 pinned this
class and its vector stopped reproducing when the second round moved the
bodies to bits; 4822165 removed both and reasoned that the reader never
places a blob, which is true and was not the divergence. The sabotage is the
one line that gates the framing on reachability again, and the run goes red on
the vector.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the element cost floor is one max, not three lines (#557)

modernize flags the if statement, and it is right: the floor an unbounded
array's count is bounded at is max( run, 1 ).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* wire: the surplus control points at the element that is still walked (#557)

make test caught a control the arithmetic surplus retired.
message-surplus-lands-on-zero asserted M1, that a discarded surplus element
never acquires a live destination, on the six findings' vector, whose `few` is
a raw uint32 array. A fixed-width surplus is not decoded at all any more, so
the sabotage that redirects the sink had nothing to redirect and the row
stayed green.

The rule still has a place to bite, and it is the element that is still
WALKED: TestAnOverLongArrayOfNonFixedElements sends nine `string(32)` rows to
a reader that keeps four, and the five walked past it decode into the sink.
The test now asserts element ZERO as well as element three, and the control
points at it:

  negative control (message-surplus-lands-on-zero):
  TestAnOverLongArrayOfNonFixedElements goes red on
  element zero reads "iii": a walked surplus element landed on it

The page says both halves of the rule in one sentence beside the walk it
belongs to, and the emitter's comment says which half its scratch is for.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

---------

Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants