Skip to content

feat(encoding): add bounded block dictionary - #8326

Draft
Xuanwo wants to merge 1 commit into
xuanwo/generic-block-v5-2-range-deltafrom
xuanwo/generic-block-v5-3-dictionary
Draft

feat(encoding): add bounded block dictionary#8326
Xuanwo wants to merge 1 commit into
xuanwo/generic-block-v5-2-range-deltafrom
xuanwo/generic-block-v5-3-dictionary

Conversation

@Xuanwo

@Xuanwo Xuanwo commented Aug 6, 2026

Copy link
Copy Markdown
Collaborator

Stack 3 of 10 for Lance generic block sequence compression.

This adds a bounded block dictionary codec for u32/u64 sequences. Dictionary values and indices remain separate typed child codec trees, with explicit frame lengths, checked cardinality, and index-bound validation before materialization.

The codec is available for later composition but is not selected by a production writer in this layer. Stable Lance 2.0–2.2 bytes and reader behavior remain unchanged.

Stack navigation

@github-actions

github-actions Bot commented Aug 6, 2026

Copy link
Copy Markdown
Contributor

Important

This PR touches the Lance format specification.

Substantive changes to the format specification — the .proto definitions
and the spec docs under docs/src/format/ — require a PMC vote before merge.
Minor edits such as typo fixes, wording, or formatting are excluded; use your
judgment.

If this is a meaningful format change:

  • Start a vote following the Lance community voting process.
    Format specification modifications need 3 binding +1 votes (excluding the
    proposer), held on GitHub Discussions, with a minimum voting period of 1 week.
  • Once the vote passes, link the completed vote in this PR. It should not be
    merged until the vote is linked.

@github-actions github-actions Bot added A-encoding Encoding, IO, file reader/writer A-format On-disk format: protos and format spec docs enhancement New feature or request labels Aug 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-encoding Encoding, IO, file reader/writer A-format On-disk format: protos and format spec docs enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant