Skip to content

Document MSTest 4.3 and 4.4 features - #55326

Merged
Evangelink merged 3 commits into
mainfrom
dev/amauryleve/document-mstest-4-3-4-4
Aug 6, 2026
Merged

Document MSTest 4.3 and 4.4 features#55326
Evangelink merged 3 commits into
mainfrom
dev/amauryleve/document-mstest-4-3-4-4

Conversation

@Evangelink

@Evangelink Evangelink commented Aug 6, 2026

Copy link
Copy Markdown
Member

Summary

  • Document all identified MSTest 4.3.x features and behavior changes, including assertion APIs, source generation, random ordering, JUnit integration, lifecycle context flow, and analyzer updates.
  • Document unreleased MSTest 4.4 features, including resource locks, test dependencies, per-test temporary directories, live output, retry reporting, fixture timeouts, browser-WASM and unpackaged WinUI support, and generic test-filter registration.
  • Add reference pages for MSTEST0072 through MSTEST0081, update changed analyzer behavior, and connect every rule through the overview, usage index, and TOC.

Content source breakdown

No content was copied verbatim.

  • MSTest 4.3.0 changelog—Added, Changed, and Fixed: Adapted into the assertion, execution, lifecycle, SDK, configuration, TestContext, and analyzer conceptual/reference pages.
  • MSTest 4.3.2 changelog—Changed and Fixed: Adapted for the ReflectionFree source-generation default.
  • MSTest 4.3.3 changelog—Changed and Fixed: Adapted for testconfig.json parsing, TestContext property scoping, and analyzer behavior corrections.
  • MSTest 4.4.0 unreleased changelog—Added and Changed: Adapted into preview documentation for global fixture timeouts, generic filter registration, and retry/reporting behavior.
  • RFC 020 (resource locks): Adapted into execution guidance and MSTEST0073–MSTEST0077 reference content.
  • RFC 021 (per-test temporary directory): Adapted into TestContext.TestTempDirectory guidance and MSTEST0077 reference content.
  • RFC 022 (test dependencies): Adapted into [DependsOn], testconfig.json dependency declarations, and MSTEST0078 guidance.
  • Analyzer release manifest, analyzer implementations, code fixes, and tests: Used to generate the new MSTEST0072–MSTEST0081 reference pages and update MSTEST0024, MSTEST0041, MSTEST0050, and MSTEST0065.
  • MSTest and MTP implementation PRs and source: Used to verify output capture, retry artifacts, platform support, SDK integration, and configuration semantics.
  • New explanatory and connective text: AI-assisted and newly generated from the primary sources above.

AI usage

This PR was created with AI assistance. Every changed or new Markdown page includes ai-usage: ai-assisted.

Expert review requested

MSTest 4.4.0 is unreleased as of August 6, 2026. Its APIs, analyzer behavior, and configuration remain preview content and might change before release. Please review the generated MSTEST0072–MSTEST0081 pages and the preview sections for ResourceLockAttribute, [DependsOn], TestTempDirectory, global fixture timeouts, and ITestFilter especially closely.

Validation

  • Ran three sequential technical and completeness review rounds, fixed every in-scope finding, and completed a clean confirmation review.
  • Ran markdownlint-cli2 across all changed Markdown files.
  • Parsed the updated TOC as YAML.
  • Verified changed-file relative links, analyzer navigation coverage, AI metadata, dependency JSON syntax, and Git whitespace.

Internal previews

Toggle expand/collapse
File Preview link
docs/core/testing/microsoft-testing-platform-retry.md docs/core/testing/microsoft-testing-platform-retry
docs/core/testing/microsoft-testing-platform-terminal-output.md docs/core/testing/microsoft-testing-platform-terminal-output
docs/core/testing/microsoft-testing-platform-test-reports.md docs/core/testing/microsoft-testing-platform-test-reports
docs/core/testing/mstest-analyzers/mstest0024.md docs/core/testing/mstest-analyzers/mstest0024
docs/core/testing/mstest-analyzers/mstest0041.md docs/core/testing/mstest-analyzers/mstest0041
docs/core/testing/mstest-analyzers/mstest0050.md docs/core/testing/mstest-analyzers/mstest0050
docs/core/testing/mstest-analyzers/mstest0065.md docs/core/testing/mstest-analyzers/mstest0065
docs/core/testing/mstest-analyzers/mstest0072.md docs/core/testing/mstest-analyzers/mstest0072
docs/core/testing/mstest-analyzers/mstest0073.md docs/core/testing/mstest-analyzers/mstest0073
docs/core/testing/mstest-analyzers/mstest0074.md docs/core/testing/mstest-analyzers/mstest0074
docs/core/testing/mstest-analyzers/mstest0075.md docs/core/testing/mstest-analyzers/mstest0075
docs/core/testing/mstest-analyzers/mstest0076.md docs/core/testing/mstest-analyzers/mstest0076
docs/core/testing/mstest-analyzers/mstest0077.md docs/core/testing/mstest-analyzers/mstest0077
docs/core/testing/mstest-analyzers/mstest0078.md docs/core/testing/mstest-analyzers/mstest0078
docs/core/testing/mstest-analyzers/mstest0079.md docs/core/testing/mstest-analyzers/mstest0079
docs/core/testing/mstest-analyzers/mstest0080.md docs/core/testing/mstest-analyzers/mstest0080
docs/core/testing/mstest-analyzers/mstest0081.md docs/core/testing/mstest-analyzers/mstest0081
docs/core/testing/mstest-analyzers/overview.md docs/core/testing/mstest-analyzers/overview
docs/core/testing/mstest-analyzers/usage-rules.md docs/core/testing/mstest-analyzers/usage-rules
docs/core/testing/unit-testing-mstest-configure.md docs/core/testing/unit-testing-mstest-configure
docs/core/testing/unit-testing-mstest-intro.md docs/core/testing/unit-testing-mstest-intro
docs/core/testing/unit-testing-mstest-sdk.md docs/core/testing/unit-testing-mstest-sdk
docs/core/testing/unit-testing-mstest-writing-tests-assertions.md docs/core/testing/unit-testing-mstest-writing-tests-assertions
docs/core/testing/unit-testing-mstest-writing-tests-controlling-execution.md docs/core/testing/unit-testing-mstest-writing-tests-controlling-execution
docs/core/testing/unit-testing-mstest-writing-tests-lifecycle.md docs/core/testing/unit-testing-mstest-writing-tests-lifecycle
docs/core/testing/unit-testing-mstest-writing-tests-testcontext.md docs/core/testing/unit-testing-mstest-writing-tests-testcontext
docs/navigate/devops-testing/toc.yml docs/navigate/devops-testing/toc

Add versioned coverage for framework, runner, configuration, and analyzer changes across MSTest 4.3.x and the 4.4 preview.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 58f566d4-864e-4b2a-9fbe-119f1afbbea8
Copilot AI review requested due to automatic review settings August 6, 2026 10:39
@Evangelink
Evangelink requested review from a team, meaghanlewis and nohwnd as code owners August 6, 2026 10:39
@dotnetrepoman dotnetrepoman Bot added this to the August 2026 milestone Aug 6, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the .NET testing documentation set to cover MSTest 4.3.x features/behavior changes and to introduce preview documentation for planned MSTest 4.4 features, including new analyzers and related configuration guidance.

Changes:

  • Add and wire up new MSTest analyzer reference pages (MSTEST0072–MSTEST0081) across TOC and analyzer indexes.
  • Expand MSTest conceptual docs with new/updated guidance (resource locks, dependencies, per-test temp directory, live output, retry reporting, AOT limitations, and more).
  • Update Microsoft.Testing.Platform docs to reflect new retry/flaky reporting and report-format behaviors.
Show a summary per file
File Description
docs/navigate/devops-testing/toc.yml Adds MSTest analyzer entries to navigation.
docs/core/testing/unit-testing-mstest-writing-tests-testcontext.md Documents per-test temp directory and output behavior updates.
docs/core/testing/unit-testing-mstest-writing-tests-lifecycle.md Adds 4.4 preview notes about AOT behavior and fixture timeouts.
docs/core/testing/unit-testing-mstest-writing-tests-controlling-execution.md Documents resource locks, dependencies, retry reporting, and CICondition example update.
docs/core/testing/unit-testing-mstest-writing-tests-assertions.md Documents new assertion behaviors/APIs added in MSTest 4.3.
docs/core/testing/unit-testing-mstest-sdk.md Documents JUnit enablement and adds/extends ITestFilter guidance.
docs/core/testing/unit-testing-mstest-intro.md Updates platform support matrix and adds 4.4 preview note/metadata.
docs/core/testing/unit-testing-mstest-configure.md Updates runsettings/testconfig.json settings docs (timeouts, output modes, dependencies, validation behavior).
docs/core/testing/mstest-analyzers/usage-rules.md Adds new rules to the usage rules index and scenario groupings.
docs/core/testing/mstest-analyzers/overview.md Adds new rules to analyzer overview and grouping sections.
docs/core/testing/mstest-analyzers/mstest0081.md New reference page for MSTEST0081.
docs/core/testing/mstest-analyzers/mstest0080.md New reference page for MSTEST0080.
docs/core/testing/mstest-analyzers/mstest0079.md New reference page for MSTEST0079.
docs/core/testing/mstest-analyzers/mstest0078.md New reference page for MSTEST0078.
docs/core/testing/mstest-analyzers/mstest0077.md New reference page for MSTEST0077.
docs/core/testing/mstest-analyzers/mstest0076.md New reference page for MSTEST0076.
docs/core/testing/mstest-analyzers/mstest0075.md New reference page for MSTEST0075.
docs/core/testing/mstest-analyzers/mstest0074.md New reference page for MSTEST0074.
docs/core/testing/mstest-analyzers/mstest0073.md New reference page for MSTEST0073.
docs/core/testing/mstest-analyzers/mstest0072.md New reference page for MSTEST0072.
docs/core/testing/mstest-analyzers/mstest0065.md Updates MSTEST0065 behavior notes for 4.3.3.
docs/core/testing/mstest-analyzers/mstest0050.md Updates MSTEST0050 metadata (severity semantics, AI metadata).
docs/core/testing/mstest-analyzers/mstest0041.md Updates MSTEST0041 metadata (code fix availability, AI metadata).
docs/core/testing/mstest-analyzers/mstest0024.md Updates MSTEST0024 metadata and notes expanded detection.
docs/core/testing/microsoft-testing-platform-test-reports.md Documents JUnit enablement and retry details in CTRF/summary behavior.
docs/core/testing/microsoft-testing-platform-terminal-output.md Adds --show-flaky-tests option documentation.
docs/core/testing/microsoft-testing-platform-retry.md Documents updated retry/flaky reporting and artifact layout semantics.

Copilot's findings

  • Files reviewed: 27/27 changed files
  • Comments generated: 3

Comment thread docs/core/testing/unit-testing-mstest-configure.md Outdated
Comment thread docs/core/testing/mstest-analyzers/mstest0024.md Outdated
Comment thread docs/core/testing/mstest-analyzers/mstest0050.md Outdated
@Evangelink
Evangelink enabled auto-merge (squash) August 6, 2026 10:48
Fix reviewer-noted typos and clarify versioned analyzer severity. Also call out the experimental custom retry APIs explicitly.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 58f566d4-864e-4b2a-9fbe-119f1afbbea8
Comment thread docs/core/testing/mstest-analyzers/mstest0077.md Outdated
Remove a redundant relative-path clause that obscured the parallel filesystem collision guidance.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 58f566d4-864e-4b2a-9fbe-119f1afbbea8
@Evangelink
Evangelink merged commit 00b3746 into main Aug 6, 2026
12 checks passed
@Evangelink
Evangelink deleted the dev/amauryleve/document-mstest-4-3-4-4 branch August 6, 2026 13:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants