Skip to content

Publish UK execution graphs through a general build emitter service - #1148

Draft
anth-volk wants to merge 20 commits into
mainfrom
feat/orrery-graph-publication
Draft

anth-volk wants to merge 20 commits into
mainfrom
feat/orrery-graph-publication

Conversation

@anth-volk

@anth-volk anth-volk commented Oct 8, 2026 •

Copy link
Copy Markdown
Contributor

Fixes #1149

Build on the graph/evidence implementation from #1144 and incorporate the emitter from #1099, without modifying either original branch. This draft targets main because the repository only runs PR CI for that target; it includes both dependency branches and should be reconciled after they merge.

The local publishing service has a component-neutral runtime and two distinct components: telemetry and completed Orrery publication. They have independent workers and queue policies, shared short-lived collector authentication, and compatibility with the original telemetry API. The service and graph retry CLI work without telemetry registration. Pending graph jobs survive missing credentials, restarts, and telemetry pruning. docs/build-emitter.md documents the extension interface. Completion updates check the worker's lease in SQL; an expired worker cannot release a replacement worker's lease or replace a published receipt with a failure.

UK full, dense, size, and national build completion exports saved execution evidence, preserves exact public-safe files, attempts graph publication before HF artifact staging, and registers graph/evidence/receipt files in the artifact manifest. Exceptions preserve graph evidence before temporary cleanup. Local-only/opt-out controls remain explicit. Retry never rewrites the original HF receipt snapshot.

Commits: merge emitter dependency; general publishing service and durable graph delivery; UK completion integration; component architecture documentation.

Validation: the complete local engine-free suite passed (15,034 passed, 136 skipped); 114 focused emitter/publication tests, 23 national-build tests, and two synthetic UK integration tests passed; repository lint and changed-file formatting passed; test-plan registry verified; all seven wheels built and passed content inspection. HTTP is mocked in producer tests; no tests call the runs app. The app independently qualified a synthetic 22,020,322-byte graph against isolated development storage. Complete CI is pending.

Dependencies: PolicyEngine/microcosm-runs#1; PolicyEngine/calibration-diagnostics#208 must merge and deploy for authenticated production uploads. No original PR branch or default branch was pushed.

@anth-volk
anth-volk changed the base branch from uk-orrery-execution-overlay to main October 8, 2026 15:42

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Publish UK execution graphs through an extensible local build service

2 participants