Skip to content

Run Argo Rollouts E2E with the Kubernetes Agent backend - #24674

Draft
nubtron wants to merge 58 commits into
masterfrom
nubtron/argo-rollouts-kubernetes-agent-e2e
Draft

Run Argo Rollouts E2E with the Kubernetes Agent backend#24674
nubtron wants to merge 58 commits into
masterfrom
nubtron/argo-rollouts-kubernetes-agent-e2e

Conversation

@nubtron

@nubtron nubtron commented Jul 23, 2026

Copy link
Copy Markdown
Collaborator

What does this PR do?

Runs the Argo Rollouts Kind E2E with the Kubernetes Agent backend introduced by #24639. The check now scrapes the controller through the in-cluster Service DNS endpoint, http://argo-rollouts-metrics.argo-rollouts.svc.cluster.local:8090/metrics, so the external Docker Agent and persistent kubectl port-forward are no longer needed.

Validation:

  • cd ddev && hatch run -- ddev --no-interactive test -fs argo_rollouts
  • cd ddev && hatch run -- ddev --no-interactive test --lint argo_rollouts
  • cd ddev && hatch run -- ddev --no-interactive test argo_rollouts (4 passed, 1 E2E skipped)
  • cd ddev && hatch run ddev env start --dev argo_rollouts py3.13-1.6.6
  • cd ddev && hatch run ddev env show argo_rollouts py3.13-1.6.6 (Agent type: Kubernetes)
  • cd ddev && hatch run ddev env test --dev argo_rollouts py3.13-1.6.6 (1 passed, 4 deselected)
  • cd ddev && hatch run ddev env stop argo_rollouts py3.13-1.6.6

Motivation

This PR is stacked on #24639 and migrates Argo Rollouts to the new backend. Running the Agent in the same Kind cluster lets it use Kubernetes Service discovery directly and removes the long-lived host-side port-forward without changing the E2E setup, waits, instances shape, assertions, or timeout behavior.

Review checklist (to be filled by reviewers)

  • Feature or bugfix MUST have appropriate tests (unit, integration, e2e)
  • Add qa/required if this PR needs QA validation, or qa/skip-qa if it does not. Exactly one of the two is required.
  • If you need to backport this PR to another branch, you can add the backport/<branch-name> label to the PR and it will automatically open a backport PR once this one is merged

@nubtron nubtron added the qa/skip-qa Automatically skip this PR for the next QA label Jul 23, 2026
@datadog-datadog-us1-prod

datadog-datadog-us1-prod Bot commented Jul 23, 2026

Copy link
Copy Markdown

Tests  Code Coverage

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

🎯 Code Coverage (details)
Patch Coverage: 0.00%
Overall Coverage: 89.74% (+1.33%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: f5b8ae8 | Docs | Datadog PR Page | Give us feedback!

@nubtron
nubtron force-pushed the nubtron/argo-rollouts-kubernetes-agent-e2e branch 4 times, most recently from 2494844 to c8cc16b Compare July 30, 2026 13:31
nubtron added 20 commits August 10, 2026 09:27
Clarified the implementation details regarding Kubernetes node support.
Reading self.metadata['kubernetes'] unguarded turned a missing metadata
block into a bare KeyError, so an environment that selects agent_type
'kubernetes' without the accompanying mapping failed with 'Unable to
start the Agent: kubernetes' and gave a raw traceback from ddev env
shell, which only handles CalledProcessError.

Validate the mapping where it is read so the failure names the missing
contract instead.
start() stamped PREPARED_MARKER after _restart_agent_process(), so a
container replaced during the restart was marked prepared. The marker
lives in the container filesystem and the pod declares no volumes, so a
replacement loses the copied conf.yaml, auto_conf.yaml and the editable
installs, while _wait_for_agent() still succeeds against the fresh
container. Every later _require_prepared() check then passed and tests
silently exercised the Agent-shipped integration with no configuration.

Stamp the marker once preparation is complete and assert it after the
restart, matching the invariant restart() already relies on. Checking
after the stamp instead would only observe the gap between the two
commands.
@nubtron
nubtron force-pushed the nubtron/kubernetes-agent-interface-e2e branch from 2a64043 to f21cf4c Compare August 10, 2026 09:28
@nubtron
nubtron force-pushed the nubtron/argo-rollouts-kubernetes-agent-e2e branch from 3c98d27 to 435896d Compare August 10, 2026 09:35
Base automatically changed from nubtron/kubernetes-agent-interface-e2e to master August 10, 2026 17:43
An error occurred while trying to automatically change base from nubtron/kubernetes-agent-interface-e2e to master August 10, 2026 17:43
@dd-octo-sts

dd-octo-sts Bot commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

Validation Report

All 21 validations passed.

Show details
Validation Description Status
agent-reqs Verify check versions match the Agent requirements file
ci Validate CI configuration and code coverage settings
codeowners Validate every integration has a CODEOWNERS entry
config Validate default configuration files against spec.yaml
dep Verify dependency pins are consistent and Agent-compatible
http Validate integrations use the HTTP wrapper correctly
imports Validate check imports do not use deprecated modules
integration-style Validate check code style conventions
jmx-metrics Validate JMX metrics definition files and config
labeler Validate PR labeler config matches integration directories
legacy-signature Validate no integration uses the legacy Agent check signature
license-headers Validate Python files have proper license headers
licenses Validate third-party license attribution list
metadata Validate metadata.csv metric definitions
models Validate configuration data models match spec.yaml
openmetrics Validate OpenMetrics integrations disable the metric limit
package Validate Python package metadata and naming
qa-label Validate the pull request declares whether it needs QA for the next Agent release
readmes Validate README files have required sections
saved-views Validate saved view JSON file structure and fields
version Validate version consistency between package and changelog

View full run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

integration/argo_rollouts qa/skip-qa Automatically skip this PR for the next QA

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant