Skip to content
This repository was archived by the owner on Nov 12, 2026. It is now read-only.

Upstream watch: store 12-character digests so the dashboard fits the issue body - #711

Merged
techmore merged 1 commit into
devfrom
claude/upstream-watch-size
Oct 31, 2026
Merged

techmore merged 1 commit into
devfrom
claude/upstream-watch-size

Conversation

@techmore

Copy link
Copy Markdown
Owner

The scheduled Watch public upstreams workflow has failed in 23 of its last 30 runs (since 2026-10-28) with Dashboard exceeds GitHub issue size. Issue #51 tracks 510 sources (434 discovered branch heads). Their 40-character SHAs barely compress, so the issue body went past 65,536 characters and nothing new has been recorded since.

Fix: change_marker keeps the first 12 characters of sha, base_sha and sha256. That's still enough to detect any move of the same ref. Stored full-length values shorten to the same prefix, so the first run after this reports no false changes. Legacy pending entries also go through the marker now.

Measured on the live dashboard: 62,920 → 38,928 characters, with all 228 pending changes and 510 snapshots kept. With every source pending the worst case is about 50.5k characters.

Tests: python3 -B -m unittest mseries/local-ai/test_github_watch.py passes 12/12. That includes a migration test (full-length values report no change) and a 520-sources-all-pending size test.

After merge, run the workflow once (gh workflow run upstream-watch.yml) to confirm it's green.

…issue body

Since 2026-10-28, 23 of the last 30 scheduled runs failed with 'Dashboard exceeds
GitHub issue size': 510 tracked sources (434 discovered branch heads) with
40-character SHAs, which barely compress, pushed issue #51 past 65,536
characters, so no new upstream changes were recorded.

change_marker now keeps the first 12 characters of sha, base_sha and sha256.
Stored full-length values shorten to the same prefix, so the first run after
this reports no false changes; legacy pending entries go through the same
marker. The live dashboard state migrates from 62.9k to 38.9k characters, and
a test covers 520 sources all pending.
@techmore
techmore merged commit 2f49a6d into dev Oct 31, 2026
18 checks passed
@techmore
techmore deleted the claude/upstream-watch-size branch October 31, 2026 17:37
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant