[DENG-10877] Create plan for v2 to v1 glean table swap#61
Open
BenWu wants to merge 2 commits into
Open
Conversation
akkomar
reviewed
Jul 6, 2026
akkomar
left a comment
akkomar
left a comment
Member
There was a problem hiding this comment.
LGTM. The only issue I see is mozilla/mozilla-schema-generator#315 (review)
| 2. Pause ingestion and BigQuery deploys for prod and stage | ||
| - https://ops-master.jenkinsv2.prod.mozaws.net/job/gcp-pipelines/job/data-ingestion-sink/ | ||
| - bigquery-prod and bigquery-stage https://ops-master.jenkinsv2.prod.mozaws.net/job/gcp-pipelines/job/data-shared/ | ||
| 3. Stop structured loader sink for prod and stage: deploy https://github.com/mozilla/dataservices-infra/compare/benwu/stage-loader-zero, which sets `enabled: false` on the `structured-decoded-loader` |
Member
There was a problem hiding this comment.
I'd also announce this in #data-platform-infra-wg
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Taken and updated from https://docs.google.com/document/d/1STMFrEpK6UPLKJGGojESJ_rniGAg3yf4RMo8H0RAeps/edit to make it easier to read and comment on with more code. All comments from there should be addressed now
For https://mozilla-hub.atlassian.net/browse/DENG-10877
Goal copied from the readme:
Replace the existing v1 glean live and stable tables with the backfilled v2 tables that carry the glean.2 schema, so the v1 table names keep working with the new schema which will have significantly fewer columns. For each table we back up the current v1, drop it, and rename v2 to v1. This runs in stage first,
then prod, starting with the test set below before the full rollout. The v2 tables already hold the validated backfill, so the swap is the remaining step to cut the pipeline over to the new schema without renaming downstream references.