Skip to content

Run dependency cache benchmarks with a candidate CLI - #75

Merged
gauravtiwari merged 3 commits into
mainfrom
deps-candidate-cli
Oct 18, 2026
Merged

gauravtiwari merged 3 commits into
mainfrom
deps-candidate-cli

Conversation

@gauravtiwari

Copy link
Copy Markdown
Contributor

Adds two deps.yml inputs for measuring an unreleased BoringCache CLI, and a Mastodon bundler case.

  • cli_artifact installs the CLI from a BoringCache artifact id instead of the released version. The job pulls it through its own OIDC session.
  • cli_jsonl keeps the CLI's JSONL observability log in each job's results artifact.
  • A run that sets either input does not publish, so it never changes the recorded results.
  • mastodon-bundler restores Mastodon's vendor/bundle (Ruby 4.0.7, native pg, charlock_holmes and idn-ruby gems). The update step is a net-ldap bump.

actionlint, bin/bench check and test/bench/deps_test.rb pass. Twelve runs dispatched from these commits completed on GitHub, Namespace and Depot runners. The Discourse bundler case failed in every lane, including actions/cache, because the rbtrace extension does not build; it fails the same way on main.

A manual dependency cache run can now take the id of a BoringCache artifact
holding an unreleased CLI build. The installer installs the pinned release,
pulls the artifact through the job's OIDC session and replaces the binary.
Runs with a candidate never publish results.
Mastodon pins Ruby 4.0.7 and builds pg, charlock_holmes and idn-ruby, so
its gem set differs from Discourse. The update step is an upstream net-ldap
bump.
A manual run with cli_jsonl writes the CLI's observability JSONL into each
job's results artifact so restore phases can be compared between CLI
builds. Such runs are never published.
@gauravtiwari
gauravtiwari merged commit bacdf12 into main Oct 18, 2026
4 checks passed
@gauravtiwari
gauravtiwari deleted the deps-candidate-cli branch October 18, 2026 22:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant