Skip to content

refactor: centralize console worker connections - #25

Open
EdsonPetry wants to merge 1 commit into
DataDog:arrow-58-59-dd-04-08-2026from
EdsonPetry:agent/console-worker-connector
Open

refactor: centralize console worker connections#25
EdsonPetry wants to merge 1 commit into
DataDog:arrow-58-59-dd-04-08-2026from
EdsonPetry:agent/console-worker-connector

Conversation

@EdsonPetry

@EdsonPetry EdsonPetry commented Aug 21, 2026

Copy link
Copy Markdown

What changed

  • Introduces one WorkerConnector abstraction for seed discovery and per-worker polling.
  • Routes reconnects and discovered-worker URL parsing through the same connection policy.
  • Preserves existing plaintext transport and bare-port CLI behavior.

Why

The console previously opened discovery and worker connections through separate paths. The follow-up PR needs both paths to apply identical logical-origin and physical-dial behavior for Fabric TLS.

Impact

No intended user-visible behavior change. This is the behavior-neutral base of the console stack.

Validation

  • cargo fmt -p datafusion-distributed-console -- --check passed.
  • Full local test/clippy builds exhausted host file descriptors while compiling aws-sdk-ec2, including with ulimit -n 8192.
  • Official CI is required before merge.

Stack

  1. This PR: centralize console connection creation.
  2. #26: logical TLS worker origins and physical pod dialing.

Ports EdsonPetry/datafusion-distributed#2 to the DataDog compatibility branch.

@EdsonPetry
EdsonPetry marked this pull request as ready for review August 21, 2026 19:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant