Skip to content

Use relative paths for spec tests to skip to avoid ambiguity when two tests have the same basename#8060

Merged
stevenfontanella merged 6 commits into
WebAssembly:mainfrom
stevenfontanella:skip-with-relative-path
Nov 20, 2025
Merged

Use relative paths for spec tests to skip to avoid ambiguity when two tests have the same basename#8060
stevenfontanella merged 6 commits into
WebAssembly:mainfrom
stevenfontanella:skip-with-relative-path

Conversation

@stevenfontanella
Copy link
Copy Markdown
Member

@stevenfontanella stevenfontanella commented Nov 19, 2025

  • Update SPEC_TESTS_TO_SKIP and SPEC_TESTSUITE_TESTS_TO_SKIP to use relative paths, which allows us to distinguish between tests with the same base name. This is useful since some future changes will fix test/spec/testsuite/memory.wast but not test/spec/testsuite/proposals/threads/memory.wast
  • Check that the user-specified --spec-test paths exist. This is also done to avoid skipping rather than erroring when the user specifies a path relative to test/ instead of relative to the repo root (since we drop the test/ prefix we can't tell the difference).

Test (after commenting the exclusion for test/spec/testsuite/proposals/threads/memory.wast, which is currently failing):
image

@stevenfontanella stevenfontanella marked this pull request as ready for review November 19, 2025 01:02
Comment thread scripts/test/shared.py
Comment thread scripts/test/shared.py Outdated
Copy link
Copy Markdown
Member

@tlively tlively left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@stevenfontanella stevenfontanella merged commit 2f79888 into WebAssembly:main Nov 20, 2025
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants