Skip to content

[doc] remove single replica compaction documentation#3870

Open
csun5285 wants to merge 1 commit into
apache:masterfrom
csun5285:doc-remove-single-replica-compaction
Open

[doc] remove single replica compaction documentation#3870
csun5285 wants to merge 1 commit into
apache:masterfrom
csun5285:doc-remove-single-replica-compaction

Conversation

@csun5285
Copy link
Copy Markdown
Contributor

@csun5285 csun5285 commented Jun 1, 2026

Remove all documentation and example references to the single replica compaction feature (enable_single_replica_compaction / max_single_replica_compaction_threads) across dev and 4.x, EN and ZH:

  • compaction.md: drop the "Single replica compaction" section and the max_single_replica_compaction_threads bullet
  • be-config.md: drop the max_single_replica_compaction_threads entry
  • CREATE-TABLE.md: drop the enable_single_replica_compaction property row
  • key-features/data-compaction.mdx: drop the related paragraph and bullet
  • connector tutorials, array-contains, basic-concepts, ccr/feature: drop the example/reference occurrences of the property

Unrelated single-replica storage / data-import mentions are left intact.

Versions

  • dev
  • 4.x
  • 3.x
  • 2.1 or older (not covered by version/language sync gate)

Languages

  • Chinese
  • English
  • Japanese candidate translation needed

Docs Checklist

  • Checked by AI
  • Test Cases Built
  • Updated required version and language counterparts, or explained why not
  • If only one language changed, confirmed whether source/translation counterparts need sync

Remove all documentation and example references to the single replica
compaction feature (enable_single_replica_compaction /
max_single_replica_compaction_threads) across dev and 4.x, EN and ZH:

- compaction.md: drop the "Single replica compaction" section and the
  max_single_replica_compaction_threads bullet
- be-config.md: drop the max_single_replica_compaction_threads entry
- CREATE-TABLE.md: drop the enable_single_replica_compaction property row
- key-features/data-compaction.mdx: drop the related paragraph and bullet
- connector tutorials, array-contains, basic-concepts, ccr/feature:
  drop the example/reference occurrences of the property

Unrelated single-replica storage / data-import mentions are left intact.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@csun5285
Copy link
Copy Markdown
Contributor Author

csun5285 commented Jun 1, 2026

run buildall

eldenmoon pushed a commit to apache/doris that referenced this pull request Jun 3, 2026
Remove the single replica compaction (SRC) feature end-to-end across BE,
FE and regression tests.

Doc: apache/doris-website#3870

 ### Why remove it

The main reason is **correctness risk in peer selection**. A follower
replica had to pick a peer holding a "proper" version
(`_find_rowset_to_fetch`) and fetch its compacted result, based on
replica info that was only refreshed
periodically. Because replicas progress through versions independently
and this "leader" selection ran against a stale, time-sensitive view of
the cluster, the hoice of which peer to fetch from — and which version —
was racy and could select a peer whose state no longer matched, leading
to subtle inconsistencies.
csun5285 added a commit to csun5285/doris that referenced this pull request Jun 3, 2026
Remove the single replica compaction (SRC) feature end-to-end across BE,
FE and regression tests.

Doc: apache/doris-website#3870

 ### Why remove it

The main reason is **correctness risk in peer selection**. A follower
replica had to pick a peer holding a "proper" version
(`_find_rowset_to_fetch`) and fetch its compacted result, based on
replica info that was only refreshed
periodically. Because replicas progress through versions independently
and this "leader" selection ran against a stale, time-sensitive view of
the cluster, the hoice of which peer to fetch from — and which version —
was racy and could select a peer whose state no longer matched, leading
to subtle inconsistencies.
csun5285 added a commit to csun5285/doris that referenced this pull request Jun 3, 2026
Remove the single replica compaction (SRC) feature end-to-end across BE,
FE and regression tests.

Doc: apache/doris-website#3870

 ### Why remove it

The main reason is **correctness risk in peer selection**. A follower
replica had to pick a peer holding a "proper" version
(`_find_rowset_to_fetch`) and fetch its compacted result, based on
replica info that was only refreshed
periodically. Because replicas progress through versions independently
and this "leader" selection ran against a stale, time-sensitive view of
the cluster, the hoice of which peer to fetch from — and which version —
was racy and could select a peer whose state no longer matched, leading
to subtle inconsistencies.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants