Skip to content

Pipe: add IoTDBSink sender port configuration - #13593

Open
luoluoyuyu wants to merge 49 commits into
apache:masterfrom
luoluoyuyu:add-port-config
Open

luoluoyuyu wants to merge 49 commits into
apache:masterfrom
luoluoyuyu:add-port-config

Conversation

@luoluoyuyu

@luoluoyuyu luoluoyuyu commented Sep 23, 2024 •

Copy link
Copy Markdown
Member

Description

As the title said


This PR has:

  • been self-reviewed.
    • concurrent read
    • concurrent write
    • concurrent read and write
  • added documentation for new or modified features or behaviors.
  • added Javadocs for most classes and all non-trivial methods.
  • added or updated version, license, or notice information
  • added comments explaining the "why" and the intent of the code wherever would not be obvious
    for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold
    for code coverage.
  • added integration tests.
  • been tested in a test IoTDB cluster.

Key changed/added classes (or packages if there are too many classes) in this PR

@luoluoyuyu
luoluoyuyu marked this pull request as draft September 23, 2024 14:34
@SteveYurongSu SteveYurongSu self-assigned this Sep 25, 2024
@luoluoyuyu
luoluoyuyu marked this pull request as ready for review September 25, 2024 08:27

@Caideyipi Caideyipi left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@luoluoyuyu
luoluoyuyu marked this pull request as draft September 29, 2024 07:00
@luoluoyuyu
luoluoyuyu marked this pull request as ready for review September 29, 2024 09:24
@SteveYurongSu
SteveYurongSu marked this pull request as draft October 12, 2024 11:58
@luoluoyuyu
luoluoyuyu marked this pull request as ready for review October 14, 2024 02:44
@SteveYurongSu
SteveYurongSu marked this pull request as draft October 18, 2024 03:30
@luoluoyuyu
luoluoyuyu marked this pull request as ready for review October 22, 2024 07:13
@luoluoyuyu
luoluoyuyu marked this pull request as draft October 22, 2024 07:13
@Caideyipi Caideyipi reopened this Jul 28, 2025
# Conflicts:
#	integration-test/src/test/java/org/apache/iotdb/pipe/it/dual/treemodel/auto/basic/IoTDBPipeConnectorCustomPortIT.java
#	iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/sink/client/IoTDBConfigNodeSyncClientManager.java
#	iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/sink/protocol/IoTDBConfigRegionSink.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/thrift/async/IoTDBDataRegionAsyncConnector.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/thrift/sync/IoTDBDataNodeSyncConnector.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/sink/client/IoTDBDataNodeAsyncClientManager.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/sink/client/IoTDBDataNodeSyncClientManager.java
#	iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/ClientPoolFactory.java
#	iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/async/AsyncPipeDataTransferServiceClient.java
#	iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/sink/client/IoTDBClientManager.java
#	iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/sink/client/IoTDBSyncClientManager.java
#	iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/sink/protocol/IoTDBSink.java
#	iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/sink/protocol/IoTDBSslSyncSink.java
@Caideyipi Caideyipi changed the title Pipe: add IoTDBConnector sender port configuration Pipe: add IoTDBSink sender port configuration Feb 25, 2026
Resolve Pipe sender-port conflicts while preserving master TLS, request slicing, thread-pool naming and overflow-safe client selection. Keep both sides' tests and localize the new port diagnostics.
@Caideyipi

Copy link
Copy Markdown
Collaborator

Self-review passed. Fixed configured send-port binding for async and sync pipe clients, prevented async client pools with different send-port ranges from being shared, and tightened send-port validation. Added regression tests for these cases.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants