[David Fowler (davidfowl)]

Description

The scheduled Outerloop Tests run on main failed in two jobs after #21880:

• Templates (ubuntu-latest): all 10 StarterTemplateWithRedisCacheTests and StarterTemplateWithRedisCacheTests_Net11 tests timed out waiting for .resource-row-sub > .state-dot + span in DashboardResourceAssertions.CheckResourcesAsync.
• Hosting.Testing (ubuntu-latest): DashboardUrlTests.DashboardDisplaysResourceUpdatesWhileAppHostIsPausedAtBreakpoint couldn't find the text "Dashboard test initial" in the resource row. The row itself was there.

Failure stats (14d, attempt 1)

Outerloop Tests workflow on microsoft/aspire, runs created 2026-10-25 06:28 → 2026-11-08 06:28 UTC, attempt 1 only. Denominator: attempt-1 jobs that ran (success or failure). Hits: the failed job's log matches the signature. Jobs that lost their runner, which have no log, are excluded.

Signature	Templates: .resource-row-sub > .state-dot + span timeout; Hosting.Testing: Dashboard test initial not found
Job	Outerloop Tests: Templates (ubuntu-latest) and Hosting.Testing (ubuntu-latest), main
main pushes: hits / runs	2 / 28 (7.14%)
main scheduled runs, 30d: hits / jobs	2 / 60 (3.33%), both on 2026-11-08. Templates also failed on main every scheduled run from 2026-10-10 to 2026-11-04 with other causes
PR runs: hits / runs	n/a (Outerloop PR runs don't run these jobs)
Combined rate	2 / 28 = 7.14%
Flake check	main: failed on all 4 attempts of the run (not a flake)
First / last hit	2026-11-08 / 2026-11-08
Still hitting main?	Hit on the latest scheduled main run (2026-11-08); no main run since
Fix evidence	Local: default-density helper tests fail with the old helper and pass with the new one. Outerloop dispatched on this PR's head: Templates and Hosting.Testing (ubuntu) passed 2/2 attempts.

Failing attempt-1 jobs, most recent first (2 of 2 log-verified hits):

Date (UTC)	Branch	Job	Signature excerpt
2026-11-08 02:06	main	Hosting.Testing (ubuntu-latest)	GetByText("Dashboard test initial", Exact) element(s) not found
2026-11-08 02:06	main	Templates (ubuntu-latest)	.resource-row-sub > .state-dot + span timeout

Verdict: STRONG (real break, not a flake). The 2026-11-08 scheduled main run failed both jobs on all 4 attempts with these signatures. The prior scheduled runs (2026-11-06 and 2026-11-07) passed, and the signature never appeared earlier in the window. Earlier Templates failures (2026-10-27 to 2026-11-04) had other causes.

Why: #21880 deliberately brought back single-line rows for Compact, the dashboard's default density. A compact row shows the state as a dot in a .resource-row-meta-state column, and the state's name is in that column's data-tooltip. There's no .resource-row-sub and no visible state text. These browser tests open the dashboard at its default density, so they no longer found the state. Aspire.Dashboard.Playwright.Tests passed because PlaywrightTestsBase pins those tests to Comfortable unless they opt into the default. This is a deterministic break, not a flake: the previous scheduled runs on main (42327544779, before #21880) passed, and the only dashboard change in between is #21880.

Fix: the tests now match the intended markup, and no assertions are dropped:

• DashboardResourceAssertions.GetRowStateAsync reads a row's state at any density. In compact rows it reads the state column's tooltip. In other densities it reads the text after the dot. RowState(row, state) finds the element that shows a given state.
• CheckResourcesAsync uses GetRowStateAsync, and keeps waiting while a row hasn't rendered a state yet.
• DashboardDisplaysResourceUpdatesWhileAppHostIsPausedAtBreakpoint waits for the initial and then the updated state with RowState.
• TemplateResourceAssertionsTests.TemplateHelper_ValidatesSidebarAndDetailsWithoutCards now runs at both the default (compact) density and Comfortable, and checks RowState directly, so the helper is covered against the real dashboard at the density the template tests use.

Confidence

• Locally, the 6 TemplateResourceAssertionsTests pass. With the old helper, the two new default-density cases fail with the same Timeout ... exceeded as the Templates job.
• Outerloop Tests dispatched on this branch to cover the Templates and Hosting.Testing jobs end to end. I didn't run those two locally; they need the full template build and container runtime.

How we stop this recurring: the shared helper's own test now runs at the dashboard's default density, so a markup change to default rows fails that test against the dashboard alone, which is fast to run locally while changing row markup and points straight at the helper. It's still an outerloop test, so it doesn't gate PR CI.

Checklist

• Is this feature complete?
  • Yes. Ready to ship.
  • No. Follow-up changes expected.
• Are you including unit tests for the changes and scenario tests if relevant?
  • Yes
  • No
• Did you add public API?
  • Yes
  • No
• Does the change make any security assumptions or guarantees?
  • Yes
  • No

🤖 Posted by AspireAgent (AI Agent)

[github-actions]

🚀 Dogfood this PR with:

⚠️ WARNING: Do not do this without first carefully reviewing the code of this PR to satisfy yourself it is safe.

curl -fsSL https://raw.githubusercontent.com/microsoft/aspire/main/eng/scripts/get-aspire-cli-pr.sh | bash -s -- 21924

Or

• Run remotely in PowerShell:

iex "& { $(irm https://raw.githubusercontent.com/microsoft/aspire/main/eng/scripts/get-aspire-cli-pr.ps1) } 21924"

[github-actions]

Tests selector

3 / 101 PR test projects · 1 PR job, from 3 changed files.

Selected PR test projects (3 / 101)

Aspire.Hosting.Testing.Tests, Aspire.Playground.Tests, Aspire.Templates.Tests

Selected PR jobs (1)

native-dashboard-validation

---

How these were chosen — grouped by what changed

🧪 tests/Shared/Playwright/DashboardResourceAssertions.cs (changed test)
→ 1 directly: Aspire.Templates.Tests
→ 1 via the project graph: Aspire.Playground.Tests

🧪 tests/Aspire.Hosting.Testing.Tests/DashboardUrlTests.cs (changed test)
→ 1 directly: Aspire.Hosting.Testing.Tests

Job reasons

Job	Triggered by
native-dashboard-validation	tests/Shared/Playwright/DashboardResourceAssertions.cs

---

Selection computed for commit f49cdda.

[Copilot]

🔵 Needs a closer look

The targeted Templates and Hosting.Testing outerloop tests in run 42450827141 have not yet executed, leaving browser/container scenarios unverified in this source-only review environment.

No open issues 🎉

What changed in this PR

Updates dashboard browser-test helpers to support the compact resource rows restored by #21880, without changing production dashboard behavior or dropping state assertions.

Changes:

• Reads resource state from compact-row tooltips or visible text at other densities, retrying when state has not rendered.
• Uses density-aware state locators in the AppHost breakpoint test.
• Extends helper regression coverage to default Compact and Comfortable densities on both resource and graph pages.

File	Description
tests/​Shared/​Playwright/​DashboardResourceAssertions.cs	Adds density-aware state reading and matching to shared resource assertions.
tests/​Aspire.Hosting.Testing.Tests/​DashboardUrlTests.cs	Uses the shared locator to verify initial and updated resource states.
tests/​Aspire.Dashboard.Playwright.Tests/​Integration/​Playwright/​TemplateResourceAssertionsTests.cs	Tests both densities and directly checks state-locator matching.

_{Review effort: Balanced}

[aspire-repo-bot]

✅ No documentation update needed.

docs_optional → test_only. No signals triggered (signal_count 0). All 3 changed files match tests/** (Playwright/dashboard browser test helpers and tests); no user-facing change.