Skip to content

ci(backend): Resync backend test durations from recent master runs - #130884

Merged
joshuarli merged 1 commit into
masterfrom
ci/resync-backend-test-durations-2026-11-12
Nov 12, 2026
Merged

joshuarli merged 1 commit into
masterfrom
ci/resync-backend-test-durations-2026-11-12

Conversation

@sentry-junior

@sentry-junior sentry-junior Bot commented Nov 12, 2026 •

Copy link
Copy Markdown
Contributor

Refreshes .github/workflows/scripts/backend-test-durations.json from recent master runs, following #129569.

Source data: the per-file median of the backend-test-durations-* artifacts from three green full-suite master backend.yml runs: 43146026608, 43140609145 and 43139806889 (master bda8d6a6f4 through d3dd278a2a). All three ran 30 shards with 4 workers on ubuntu-26.04, with no .github/ changes between them. The file was built with the merge then median commands in the backend-test-durations.py docstring and is unedited.

What changed vs master (last resync: #130382)

  • 9 test files added, 17 removed. Added: telemetry_classifiers (3), runner/test_main.py, runner/commands/test_devserver.py, debug/utils/test_packages.py, cadence/test_registry.py, receivers/test_users.py, seer/autofix/test_prompt_redaction.py. Removed: 16 old tests/sentry/notebooks/**/*investigation* file names and tests/sentry/migrations/test_0125_clean_up_metric_detector_config.py; none of them exist on master anymore.
  • seconds_per_test: 0.406 → 0.386 (−4.9%).
  • Files in both versions: total time −5.2% (20,089s → 19,038s). Three files moved by more than 25% and 30s:
    • tests/sentry/api/endpoints/test_organization_releases.py 57.1s → 87.3s (runs: 75.8 / 87.3 / 105.6)
    • tests/sentry/api/endpoints/test_organization_ai_conversation_details.py 47.2s → 78.8s (runs: 64.2 / 78.8 / 82.5)
    • tests/sentry/api/endpoints/test_api_tokens.py 41.1s → 7.5s
  • The first two are >50% and >30s above the checked-in value. Neither test file changed since the last resync's source runs, so the cause is unclear (could be source changes or runner variance; not verified).

Not changed: WORKER_SECONDS_PER_SHARD. Shared files shifted well under 15%, so the budget doesn't need retuning.

Checks: test_backend_test_durations.py, test_calculate_backend_test_shards.py and test_pytest_selected.py pass (58 tests), and prek passes on the changed file.

Opened by the nightly backend CI audit.

via automation sched_de6a73f860e60ba77d1f3cfb024722f2 · Run ID sched_de6a73f860e60ba77d1f3cfb024722f2:1794470400000.

--

View Session [Sentry]

Per-file medians from green full-suite master runs 43146026608,
43140609145 and 43139806889 (30 shards, 4 workers, ubuntu-26.04).
@sentry-junior
sentry-junior Bot requested a review from joshuarli November 12, 2026 08:06
@joshuarli
joshuarli marked this pull request as ready for review November 12, 2026 18:21
@joshuarli
joshuarli requested a review from a team as a code owner November 12, 2026 18:21
@joshuarli
joshuarli merged commit e493680 into master Nov 12, 2026
66 checks passed
@joshuarli
joshuarli deleted the ci/resync-backend-test-durations-2026-11-12 branch November 12, 2026 18:21
@cursor

cursor Bot commented Nov 12, 2026

Copy link
Copy Markdown
Contributor

This PR is too large for Bugbot to review. It changes 4,124 lines and 318,056 characters. Split the change into smaller pull requests to get a review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant