Skip to content

[Extension]: Add Test-By Extension #4725

Closed

Description

@andstepanuk

Extension ID

test-by

Extension Name

Test Validation

Version

1.2.0

Description

Validate acceptance scenarios and run CSV-driven E2E tests against a live app via Playwright

Author

Andrei Stsepaniuk

Repository URL

https://github.com/andstepanuk/speckit-test-validate

Download URL

https://github.com/andstepanuk/speckit-test-validate/archive/refs/tags/v1.2.0.zip

License

MIT

Homepage (optional)

https://github.com/andstepanuk/speckit-test-validate

Documentation URL (optional)

https://github.com/andstepanuk/speckit-test-validate/tree/main/docs

Changelog URL (optional)

https://github.com/andstepanuk/speckit-test-validate/blob/main/CHANGELOG.md

Required Spec Kit Version

$>$= 0.2.0

Required Tools (optional)

- playwright (>0.0.10) - required

Number of Commands

2

Number of Hooks (optional)

0

Tags

testing, e2e, playwright

Key Features

  • Executes spec.md acceptance scenarios step-by-step in a real browser
  • Validate any steps from csv in real browser

Testing Checklist

  • Extension installs successfully via download URL
  • All commands execute without errors
  • Documentation is complete and accurate
  • No security vulnerabilities identified
  • Tested on at least one real project

Submission Requirements

  • Valid extension.yml manifest included
  • README.md with installation and usage instructions
  • LICENSE file included
  • GitHub release created with version tag
  • All command files exist and are properly formatted
  • Extension ID follows naming conventions (lowercase-with-hyphens)

Testing Details

Tested on:

  • Windows 11 with SpecKit v0.1.0

Test Project: Tested on browser application for travelers. Extension help do manual validation that features was implemented correctly

Test scenarios:

  1. Installed extension
  2. Configured settings
  3. Ran all commands
  4. Verified output

Example Usage

# Install extension
specify extension add test-by --from https://github.com/andstepanuk/speckit-test-validate/archive/refs/tags/v1.2.0.zip

#Use a command
/speckit-test-by-validate

/speckit-test-by-e2e tests/login-flow.csv

Proposed Catalog Entry

{
	"test-by": {
		"name": "Test Validation",
	  "id": "test-by",
	  "description": "Validate acceptance scenarios and run CSV-driven E2E tests against a live app via Playwright",
	  "author": "Andrei Stsepaniuk",
	  "version": "1.2.0",
	  "download_url": "https://github.com/andstepanuk/speckit-test-validate/archive/refs/tags/v1.2.0.zip",
	  "repository": "https://github.com/andstepanuk/speckit-test-validate",
	  "homepage": "https://github.com/andstepanuk/speckit-test-validate",
	  "license": "MIT",
	  "requires": {
		"speckit_version": ">=0.2.0",
		"tools": [
		  {
			"name": "playwright",
			"required": "true"
		  }
		]
	  },
	  "provides": {
		"commands": "2"
	  },
	  "tags": ["testing", "e2e"],
	  "verified": "false",
	  "downloads": "0",
	  "stars": "0",
	  "created_at": "2026-09-23T00:00:00Z",
	  "updated_at": "2026-09-23T00:00:00Z"
	}
}

Additional Context

No response

Activity

  1. changed the title [-][Extension]: Add[/-] [+][Extension]: Add Test-By Extension[/+] on Sep 24, 2026
  2. added
    triage-can-waitVerdict: valid and in-scope but deprioritized; held behind the evidence gate
    triage-must-haveVerdict: high-value, important work for Spec Kit — do first
    and removed
    triage-can-waitVerdict: valid and in-scope but deprioritized; held behind the evidence gate
    on Sep 24, 2026
  3. github-actions commented on Sep 24, 2026

    @github-actions
    Contributor

    cc @github/spec-kit-maintainers — new catalog submission for review.

  4. added a commit that references this issue on Sep 24, 2026
    9fa7d3e
  5. github-actions commented on Sep 24, 2026

    @github-actions
    Contributor

    Pull request created: #4732

    Generated by Add Community Extension from Issue Submission · copilot · gpt52codex · 3.36 AIC · ⌖ 8.04 AIC · ⊞ 23.9K

  6. KSchlobohm commented on Sep 24, 2026

    @KSchlobohm
    Contributor

    Please update the release archive so extension.yml declares the same version as the release tag and catalog entry. If you publish a new tag, update the submission's version and download URL to match. Maintainers will review the updated revision.

  7. 5 remaining items

  8. added a commit that references this issue on Sep 25, 2026
    55be31a
  9. github-actions commented on Sep 25, 2026

    @github-actions
    Contributor

    Pull request created: #4750

    Generated by Add Community Extension from Issue Submission · copilot · gpt52codex · 3.31 AIC · ⌖ 18.9 AIC · ⊞ 23.9K

  10. KSchlobohm commented on Sep 25, 2026

    @KSchlobohm
    Contributor

    Hi @andstepanuk — Copilot’s review identified a finding that must be addressed to continue: please publish a corrected v1.2.0 archive/tag whose extension.yml declares version 1.2.0, refresh the archive checksum, and update the submission details if needed. Once the issue is updated, maintainers will review the latest changes.

  11. andstepanuk commented on Sep 25, 2026

    @andstepanuk
    Author

    sorry, my bad
    Finally fix archive with correct version in extension.yml

  12. added a commit that references this issue on Sep 25, 2026
    0d677b5
  13. github-actions commented on Sep 25, 2026

    @github-actions
    Contributor

    Pull request created: #4760

    Generated by Add Community Extension from Issue Submission · copilot · gpt52codex · 2.75 AIC · ⌖ 7.44 AIC · ⊞ 17.1K

  14. added a commit that references this issue on Sep 25, 2026
    288e5a2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions