Skip to content

Source mysql gtid patch v7#130

Open
pragyash258 wants to merge 3503 commits into
masterfrom
source-mysql-gtid-patch-v7
Open

Source mysql gtid patch v7#130
pragyash258 wants to merge 3503 commits into
masterfrom
source-mysql-gtid-patch-v7

Conversation

@pragyash258

Copy link
Copy Markdown
Collaborator

What

How

Review guide

User Impact

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

tryangul and others added 30 commits April 29, 2026 16:32
…q#77568)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…ehq#77566)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…q#77610)

Co-authored-by: ian-at-airbyte <187576150+ian-at-airbyte@users.noreply.github.com>
Co-authored-by: ian-at-airbyte <187576150+ian-at-airbyte@users.noreply.github.com>
airbytehq#77622)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…ce_file_url (airbytehq#77033)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: bot_apk <apk@cognition.ai>
…onses (airbytehq#77607)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: bot_apk <apk@cognition.ai>
… Interfaces page (airbytehq#77572)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…e App" (airbytehq#77632)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Ian Alton <ian.alton@airbyte.io>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
…irbytehq#77635)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…rbytehq#77615)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…irbytehq#77611)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…irbytehq#77589)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Christo Grabowski <christo.grab@gmail.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…docs (airbytehq#77125)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…irbytehq#77582)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Ian Alton <ian.alton@airbyte.io>
…7634)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…q#77602)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…ad_ts check (airbytehq#77628)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: bot_apk <apk@cognition.ai>
…rrect start_date schema format (airbytehq#77593)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…ation 3) (airbytehq#77645)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: octavia-squidington-iii <90398440+octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
airbytehq#77644)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: bot_apk <apk@cognition.ai>
ian-at-airbyte and others added 27 commits May 19, 2026 16:00
…hq#78238)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…8274)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: bot_apk <apk@cognition.ai>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…ING.md files (airbytehq#78281)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: ian-at-airbyte <187576150+ian-at-airbyte@users.noreply.github.com>
…8285)

Co-authored-by: octavia-squidington-iii <90398440+octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
…o v25 (airbytehq#75457)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: bot_apk <apk@cognition.ai>
Co-authored-by: Danylo Jablonski <daniel.i.jablonski@globallogic.com>
Co-authored-by: gl_anatolii.yatsuk <gl_anatolii.yatsuk@airbyte.io>
…bytehq#78287)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…endpoint (airbytehq#70448)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: bot_apk <apk@cognition.ai>
Co-authored-by: Danylo Jablonski <daniel.i.jablonski@globallogic.com>
Co-authored-by: gl_anatolii.yatsuk <gl_anatolii.yatsuk@airbyte.io>
Co-authored-by: Anatolii Yatsuk <tolikyatsuk@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Kat Wilson <markhamka@gmail.com>
…hq#77780)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…nfig example (airbytehq#78294)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…ency (airbytehq#78275)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
…bytehq#78152)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: ian-at-airbyte <187576150+ian-at-airbyte@users.noreply.github.com>
…#78322)

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
)

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
…ades

Three defensive layers added to source-mysql so CDC connections survive
RDS master/replica swaps, RDS failover, and minor/major version upgrades
without requiring a full historical resync:

1. Debezium 3.4.2.Final via enforcedPlatform BOM in source-mysql's
   build.gradle. Picks up the null-safe MySqlGtidSet.subtract() fix from
   Debezium upstream (issue-6894) which addresses the NPE in Airbyte
   issue airbytehq#75558.

2. Defensive try/catch around MySqlGtidSet.subtract() in
   MySqlSourceDebeziumOperations.validate(). Any residual NPE surfaces as
   a clean ConfigErrorException with an actionable message rather than an
   opaque stack trace.

3. UUID reconciliation runs before the standard containment/subtract
   checks: auto-injects server UUIDs that saved state doesn't have (e.g.
   a replica's local-write UUID on first sync from that host), auto-prunes
   saved-state UUIDs that the server doesn't have (e.g. after swapping
   from replica to master). Also resets the offset's binlog file/pos to
   the oldest available on the new host when the saved file isn't there,
   so the CDK's cursor comparison doesn't short-circuit on hostname
   swaps. Preserves cursor when the saved file is still on the host
   (same-host state edits).

4. Full schema-history rebuild via information_schema.tables + SHOW
   CREATE TABLE at each validate() invocation. Replaces stale or
   incomplete Debezium schema history (a systemic issue on managed MySQL
   where binlog retention can age out CREATE TABLE DDL) with a fresh,
   complete set matching the currently-connected source's schema. Falls
   back to existing history if any SHOW CREATE TABLE call fails.

metadata.yaml bumps dockerImageTag to 3.52.3-gtid-patch-v7 and points
dockerRepository at tanishq171/source-mysql (BrowserStack internal
mirror).

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown

👋 Welcome to Airbyte!

Thank you for your contribution from browserstack/airbyte! We're excited to have you in the Airbyte community.

If you have any questions, feel free to ask in the PR comments or join our Slack community.

💡 Show Tips and Tricks

PR Slash Commands

As needed or by request, Airbyte Maintainers can execute the following slash commands on your PR:

  • /format-fix - Fixes most formatting issues.
  • /bump-version - Bumps connector versions.
  • /run-connector-tests - Runs connector tests.
  • /run-cat-tests - Runs CAT tests.
  • /run-regression-tests - Runs regression tests for the modified connector(s).
  • /build-connector-images - Builds and publishes a pre-release docker image for the modified connector(s).
  • /publish-connectors-prerelease - Publishes pre-release connector builds (tagged as {version}-preview.{git-sha}) for all modified connectors in the PR.
  • /ai-review - AI-powered PR review for connector safety and quality gates.
  • /force-merge reason="<A_GOOD_REASON>" - Force merges the PR using admin privileges, bypassing CI checks. Requires a reason.

Tips for Working with CI

  1. Pre-Release Checks. Please pay attention to these, as they contain standard checks on the metadata.yaml file, docs requirements, etc. If you need help resolving a pre-release check, please ask a maintainer.
    • Note: If you are creating a new connector, please be sure to replace the default logo.svg file with a suitable icon.
  2. Connector CI Tests. Some failures here may be expected if your tests require credentials. Please review these results to ensure (1) unit tests are passing, if applicable, and (2) integration tests pass to the degree possible and expected.
  3. (Optional.) BYO Connector Credentials for tests in your fork. You can optionally set up your fork with BYO credentials for your connector. This can significantly speed up your review, ensuring your changes are fully tested before the maintainers begin their review.
📚 Show Repo Guidance

Helpful Resources

📝 Edit this welcome message.

@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown

⚠️ PR Configuration Issue Detected

Hi @pragyash258, thank you for your contribution from browserstack/airbyte!

We've detected an issue with your PR configuration that is a barrier to effective and efficient review. To streamline your PR review and acceptance, Airbyte maintainers require the ability to push commits directly to your PR branch to apply formatting fixes, dependency updates, security patches, and other minor changes.

Specific details of the issue detected in your PR:

🏢 Organization Fork Detected

We have detected that your PR is from an organization fork rather than a personal fork. GitHub does not allow maintainers to commit directly to branches in organization forks. Learn more about allowing changes to a pull request branch created from a fork.

How to Fix:

  1. Fork the Airbyte repository under your personal GitHub account (not your organization).
  2. Push your branch to your personal fork.
  3. Create a new PR from your personal fork.

This will allow Airbyte maintainers to push any necessary fixes directly to your branch, significantly speeding up the review process.

Need Help?

If you have questions or need assistance, please:

Thank you for your understanding and for contributing to Airbyte! 🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.