Skip to content

Describe Orrery publication without the closed authorization route - #1403

Open
anth-volk wants to merge 4 commits into
mainfrom
claude/orrery-doc-collector-publication
Open

anth-volk wants to merge 4 commits into
mainfrom
claude/orrery-doc-collector-publication

Conversation

@anth-volk

@anth-volk anth-volk commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Fixes #1402

Summary

Documentation only (docs/orrery-publication.md and two README paragraphs).

  • New "Status" section of docs/orrery-publication.md:
    • No upload is published today. The runs application accepts an upload only after the collector authorizes it, and the collector has no authorization endpoint: Authorize independent immutable graph publications calibration-diagnostics#208 was closed unmerged.
    • Builds still queue uploads. A queued job stays pending in the emitter's local queue, its files stay in the preserved directory, and no retry can succeed.
    • The collector will build the Orrery graph files itself: builds submit the graph's inputs (graph.schema.json, graph.execution.json, upstream files and the private native evidence, but not graph.orrery.json) to its artifact intake (Accept artifact submissions into private storage and run worker jobs microcosm-collector#12), and its Orrery worker builds graph.orrery.json from the schema and the execution overlay. The worker keeps the graph of a build that used licensed microdata, as UK builds do, private until output clearance. The direct upload to the runs application is then removed.
    • By default, a build queues an upload only when remote staging is enabled, then stages to Hugging Face under staged/<run_id>/ a bundle holding every file of the queued upload plus graph.execution.json when execution was recorded. The section names the exceptions: an interrupted build, --publish-orrery while staging is local-only or disabled, and Hugging Face staging that failed or did not complete.
  • Configuration and migration sections: no longer name Correct current congressional district vintage label #208 or a hosted authorization deployment as a prerequisite.
  • README.md: says that no upload is published today, linking the new Status section, and replaces the out-of-date sentence that a published emitter release is required before merge (it linked a #deferred-migration-prerequisites heading the doc no longer has) with a link to the doc's "Emitter dependency" section: Microcosm pins one exact emitter release.

What the statements rest on

  • uk_runtime/orrery_publication.py: publication_enabled enables the upload by default only when remote staging is on, and --publish-orrery overrides that. finalize_graph registers every Orrery file in the manifest that the staged bundle is built from.
  • uk_runtime/full_build_cli.py: an interrupted build queues the job but returns before staging to Hugging Face.
  • microcosm-emitter 0.2.1, the version Microcosm pins (orrery/service/queue.py): every failed attempt leaves the job pending, there is no limit on attempts, and rows are kept "until publication or operator action".
  • The collector's submission contract (docs/artifact-submissions.md on the microcosm-collector#12 branch): the orrery-inputs kind takes the schema, the execution overlay, upstream files and evidence, and graph.orrery.json maps to no role because the collector projects its own. Its Disclosure section says the Orrery worker records every Orrery artifact from a submission with licensed_data: true as private, never makes it public itself, and that it becomes public only after output clearance.
  • packages/microcosm-build/pyproject.toml requires microcosm-emitter==0.2.1, and uv.lock records that release from PyPI.
  • microcosm-runs lib/auth.ts: each upload is sent to the collector's /v1/auth/graph-publication/authorize. The deployed collector's OpenAPI document lists only health, token-exchange and telemetry routes, and that path answers 404.

Checks

  • ruff check . (Ruff 0.15.16, as locked): passes.
  • python3 tools/ci_test_plan.py verify: passes.
  • No tests: no code changed, and no test reads this document.

🤖 Generated with Claude Code

docs/orrery-publication.md still named PolicyEngine/calibration-diagnostics#208
as a prerequisite for remote publication. That PR was closed unmerged, and the
collector will publish Orrery graph files itself instead.

Add a Status section: no upload is published today, queued jobs stay pending
with their files preserved, the collector's artifact intake
(PolicyEngine/microcosm-collector#12) and graph worker replace the direct
upload, and the Hugging Face staged bundle holds the same files. Drop the
#208 prerequisite from the configuration and migration sections.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
anth-volk and others added 3 commits October 26, 2026 20:00
…ceptions

The Status section said builds will submit "the files" to the collector's
artifact intake, which reads as the Orrery graph files. Per the collector's
submission contract, builds submit the graph's inputs (graph.schema.json,
graph.execution.json, upstream files and the private native evidence) and
the collector's Orrery worker builds graph.orrery.json itself.

Also say that the staged bundle holds every file of the queued upload plus
graph.execution.json, that default queuing depends on remote staging being
enabled, and that the bundle is missing when Hugging Face staging did not
complete, not only when it failed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The README said UK builds attempt immutable publication without saying that
no upload is published today, and it linked a "deferred migration
prerequisites" heading that the doc no longer has.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The Status section said the collector's Orrery worker will build
graph.orrery.json and publish it. The collector's submission contract
(docs/artifact-submissions.md, Disclosure, on the microcosm-collector#12
branch) says the worker records every Orrery artifact derived from a
submission with licensed_data: true as private, never makes it public
itself, and that it becomes public only after output clearance. UK builds
use licensed microdata, so the worker will not publish their graphs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@anth-volk
anth-volk marked this pull request as ready for review October 27, 2026 12:42

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Orrery publication doc still names the closed calibration-diagnostics#208 as a prerequisite

1 participant