Repository navigation
Conversation
Co-authored-by: mregrock <mregrock@ydb.tech> (cherry picked from commit 0ef48df)
…b-platform#58270) (cherry picked from commit 090bd4b)
Apply upstream ydb-platform#58424 (011b520) and ydb-platform#58500 (4ade424). Keep Bridge schema field IDs and adapt dstool canonical traces to the release branch.
…e original pile (ydb-platform#58677) (cherry picked from commit 7ff170b)
…ration (ydb-platform#58600) Co-authored-by: Azusa <> (cherry picked from commit e43b4ea)
Apply upstream ydb-platform#58471 (bd35691) and ydb-platform#58583 (4321143) with the Bridge NodeWarden configuration representation and existing test factory.
|
⚪ ⚪ DetailsYa make output | Test bloat | Test bloat
⚪ Ya make output | Test bloat | Test bloat | Test bloat
🟢
*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation |
…ydb-platform#57296) (cherry picked from commit 63842ff)
…orm#58224) Co-authored-by: Mayuri <hoshinoito@proton.me> (cherry picked from commit be93154)
(cherry picked from commit ec05134)
… copy rate (ydb-platform#58670) Co-authored-by: Rutkovsky Alexander <alexvru@localhost.localdomain> (cherry picked from commit 143e43a)
(cherry picked from commit 7b919f2)
(cherry picked from commit 8ef2389)
…latform#57914) Keep the stable same-node grouping for merged VDisk issues and apply it to missing-data issues. (cherry picked from commit bc3bb01)
Import the production application and its C++ unit tests from main at a5bba88. Includes the initial application (ydb-platform#58322), operational HTTP console (ydb-platform#58458), fixture path fixes (ydb-platform#58647), fallback evidence (ydb-platform#58779), and failover timing updates (ydb-platform#58858). Register the standalone executable and its four C++ modules. Keep its compiled HTTP console, example configuration and test fixtures.
…db-platform#58858) Keep the stable Bridge test harness dependencies and let the latency cases opt into in-memory PDisks. Tests from 1bd7c7f and 5ada536.
|
⚪ ⚪ Ya make output | Test bloat | Test bloat
🟢
*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation |
8c79248
into
ydb-platform:stable-26-3-1-17-bridge
Backport recent Bridge fixes onto
stable-26-3-1-17-bridgeafter #58411 and the embedded UI hotfix.Hive recovers pending drains after restart and places per-DC followers correctly during drain and promotion. It checks boot-attempt identity before retrying delivery failures. Backports Fix Hive bridge drain recovery and per-DC followers #56221 for Hive: перенос таблеток может завершиться до появления готовых узлов нового primary #57749 and Hive: после рестарта пропадает follower в ведомом пайле #57750, and the follow-up Fix race conditions in hive after adding proper checks #58871.
NodeWarden keeps its startup static services when self-management is disabled. VDisk accepts a PDisk
ERRORreply while in the error state. Backports NodeWarden: do not apply startup static service set without self-management #58471 and Handle an ERROR answer of the PDisk in the VDisk error state #58583.Replication clears the phantom-only marker when it finds new non-phantom evidence. Backports Clear phantom-only status on new non-phantom replication evidence #58270, a follow-up to Treat phantoms-only replicating VDisks as working ones per user request #55651.
BSC balances syncers across eligible nodes and caps the cluster-wide number by default at 64. Static syncers count toward the cap and start without waiting.
dstool cluster set --bridge-sync-max-syncerschanges the limit, and zero removes it. Backports Bridge: limit the number of syncers running in the whole cluster and spread them over nodes #58424 and Bridge: follow-ups to the limit of syncers #58500.New groups in a converted cluster retain their physical group in the original pile as an inline part when that pile is available. Requests to bridged parts require a group generation, and scrub tracks the generation across reconfiguration. Backports Bridge: create new groups of converted clusters as inline piles in the original pile #58677 and Refuse requests to a part of bridged group that come without its generation #58600.
BSC tolerates syncers reporting removed source groups during node registration. ConfigV2 rejects concurrent replacements without disrupting the active request and ignores stale Console validation replies. Backports Fix BSC abort on removed syncer source #58914 and BSC: refuse a concurrent replacement without touching the ongoing one #57296.
VDisk balancing returns the replication token or withdraws its pending request when the actor stops. The sender skips unreadable handoff parts. Backports Return the repl token when the balancing actor is poisoned #58224 and Skip unreadable handoff parts in the balancing sender #58179.
Bridge syncers report remaining bytes and copy rate by pile and storage pool through BSC and the cluster viewer. Backports Bridge: report the bytes left to copy into piles getting back and the copy rate #58670 and updates the BSC schema canonical.
Bridge CLI lists pile, database, and group synchronization through the new read-only Bridge RPCs and C++ SDK. Backports Collect bridge synchronization diagnostics in BSC #58793 and the synchronization portion of Expose bridge synchronization diagnostics through RPC and CLI #58794. The stable
GetClusterStatecontract andset-database-mode --target-databasespelling are preserved.Bridge Skipper ships as a standalone executable with its HTTP console, BSC-host fallback evidence and faster default failover. Backports the application from Initial bridge skipper #58322 and Initial Skipper UI #58458 with fixes Resolve bridge skipper test data paths relative to source files #58647, Confirm Skipper BSC-host failure from fallback evidence #58779 and Reduce Skipper default failover latency #58858. The real-server qualification tests come from Bridge Skipper: add real-server P0 qualification tests #58748 and Reduce Skipper default failover latency #58858.
SelfCheck preserves request accounting on BSC fallback and distinguishes missing Whiteboard responses from disk or node failures. Backports fix requests accounting in bsc fallback path #55582 and Distinguish missing whiteboard data from failures in SelfCheck #57914 for Skipper’s health decisions.
Hive adaptations use the existing Bridge actor APIs. The syncer limit keeps the upstream field numbers and has matching BSC schema and dstool canonicals for this branch.
The new
dstool cluster getfield expects the updated BSC response. During a direct pile disconnect with a tablet still starting, the upstream Hive code can leave the starting-tablet gauge high. Hive placement uses the per-node tablet state.The previous head passed all 102 local tests in eight suites. The run covered Hive drain and followers, NodeWarden and VDisk, syncer placement and limits, inline groups, scrub and phantom replication, V1/V2 configuration migration, and the BSC schema and dstool canonicals. On the first follow-up head, all 16 focused tests passed with three repetitions. This includes
THiveTest::TestHiveBalancerWithPreferredDC3, the Hive boot-attempt tests, ConfigV2 replacement races, the removed-source syncer and the replication-token regressions. On the final head67868328c92, all 79 focused tests passed across seven suites, covering Bridge synchronization and VDisk balancing, BSC diagnostics, the Bridge RPCs, CLI and C++ SDK, and the BSC schema canonical.Skipper builds successfully. All 331 selected tests passed, including eight real-server scenarios. Failover committed after 10.595 s with two nodes killed, 10.834 s with the pile killed, and 13.661 s with the pile frozen.