Repository navigation
[Extension]: Add Test-By Extension #4725
Copy link
Copy link
Closed
Labels
extension-submissiontriage-must-haveVerdict: high-value, important work for Spec Kit — do firstVerdict: high-value, important work for Spec Kit — do firstvalidation-passed
Description
Extension ID
test-by
Extension Name
Test Validation
Version
1.2.0
Description
Validate acceptance scenarios and run CSV-driven E2E tests against a live app via Playwright
Author
Andrei Stsepaniuk
Repository URL
https://github.com/andstepanuk/speckit-test-validate
Download URL
https://github.com/andstepanuk/speckit-test-validate/archive/refs/tags/v1.2.0.zip
License
MIT
Homepage (optional)
https://github.com/andstepanuk/speckit-test-validate
Documentation URL (optional)
https://github.com/andstepanuk/speckit-test-validate/tree/main/docs
Changelog URL (optional)
https://github.com/andstepanuk/speckit-test-validate/blob/main/CHANGELOG.md
Required Spec Kit Version
Required Tools (optional)
- playwright (>0.0.10) - requiredNumber of Commands
2
Number of Hooks (optional)
0
Tags
testing, e2e, playwright
Key Features
- Executes spec.md acceptance scenarios step-by-step in a real browser
- Validate any steps from csv in real browser
Testing Checklist
- Extension installs successfully via download URL
- All commands execute without errors
- Documentation is complete and accurate
- No security vulnerabilities identified
- Tested on at least one real project
Submission Requirements
- Valid
extension.ymlmanifest included - README.md with installation and usage instructions
- LICENSE file included
- GitHub release created with version tag
- All command files exist and are properly formatted
- Extension ID follows naming conventions (lowercase-with-hyphens)
Testing Details
Tested on:
- Windows 11 with SpecKit v0.1.0
Test Project: Tested on browser application for travelers. Extension help do manual validation that features was implemented correctly
Test scenarios:
- Installed extension
- Configured settings
- Ran all commands
- Verified output
Example Usage
# Install extension
specify extension add test-by --from https://github.com/andstepanuk/speckit-test-validate/archive/refs/tags/v1.2.0.zip
#Use a command
/speckit-test-by-validate
/speckit-test-by-e2e tests/login-flow.csvProposed Catalog Entry
{
"test-by": {
"name": "Test Validation",
"id": "test-by",
"description": "Validate acceptance scenarios and run CSV-driven E2E tests against a live app via Playwright",
"author": "Andrei Stsepaniuk",
"version": "1.2.0",
"download_url": "https://github.com/andstepanuk/speckit-test-validate/archive/refs/tags/v1.2.0.zip",
"repository": "https://github.com/andstepanuk/speckit-test-validate",
"homepage": "https://github.com/andstepanuk/speckit-test-validate",
"license": "MIT",
"requires": {
"speckit_version": ">=0.2.0",
"tools": [
{
"name": "playwright",
"required": "true"
}
]
},
"provides": {
"commands": "2"
},
"tags": ["testing", "e2e"],
"verified": "false",
"downloads": "0",
"stars": "0",
"created_at": "2026-09-23T00:00:00Z",
"updated_at": "2026-09-23T00:00:00Z"
}
}Additional Context
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
extension-submissiontriage-must-haveVerdict: high-value, important work for Spec Kit — do firstVerdict: high-value, important work for Spec Kit — do firstvalidation-passed
Activity
[-][Extension]: Add[/-][+][Extension]: Add Test-By Extension[/+]github-actions commentedon Sep 24, 2026
cc @github/spec-kit-maintainers — new catalog submission for review.
Add Test Validation extension to community catalog
github-actions commentedon Sep 24, 2026
Pull request created: #4732
KSchlobohm commentedon Sep 24, 2026
Please update the release archive so
extension.ymldeclares the same version as the release tag and catalog entry. If you publish a new tag, update the submission's version and download URL to match. Maintainers will review the updated revision.5 remaining items
Add Test Validation extension to community catalog
github-actions commentedon Sep 25, 2026
Pull request created: #4750
KSchlobohm commentedon Sep 25, 2026
Hi @andstepanuk — Copilot’s review identified a finding that must be addressed to continue: please publish a corrected v1.2.0 archive/tag whose
extension.ymldeclares version 1.2.0, refresh the archive checksum, and update the submission details if needed. Once the issue is updated, maintainers will review the latest changes.andstepanuk commentedon Sep 25, 2026
sorry, my bad
Finally fix archive with correct version in extension.yml
Add Test Validation extension to community catalog
github-actions commentedon Sep 25, 2026
Pull request created: #4760
[extension] Add Test Validation extension to community catalog (githu…