Skip to content

creating qa skill based on retro feedback - #162

Open
prograhamming wants to merge 3 commits into
mainfrom
create-qa-check-story-skill
Open

creating qa skill based on retro feedback#162
prograhamming wants to merge 3 commits into
mainfrom
create-qa-check-story-skill

Conversation

@prograhamming

@prograhamming prograhamming commented Jul 13, 2026

Copy link
Copy Markdown

🎟️ Tracking

AI-27

📔 Objective

@github-actions

github-actions Bot commented Jul 13, 2026

Copy link
Copy Markdown

Plugin Validation Summary — PR #162

Scope: New skill evaluating-qa-readiness added to bitwarden-atlassian-tools.

Files reviewed:

  • plugins/bitwarden-atlassian-tools/skills/evaluating-qa-readiness/SKILL.md (new)
  • plugins/bitwarden-atlassian-tools/skills/evaluating-qa-readiness/examples/sample_evaluation.md (new)
  • plugins/bitwarden-atlassian-tools/skills/evaluating-qa-readiness/references/criteria.md (new)

Overall: ❌ Request changes — one blocking policy violation. The skill itself is structurally sound, secure, and high quality; the PR is missing the mandatory version bump and changelog entry.


🔴 Critical (must fix)

1. Missing mandatory version bump + changelog entry for a substantive change
.claude/CLAUDE.md requires that any substantive plugin change — explicitly including adding a new skill — bumps the semantic version across all files and adds a CHANGELOG.md entry, in the same PR. This PR adds a whole new skill but leaves the version untouched:

  • plugins/bitwarden-atlassian-tools/.claude-plugin/plugin.json:3 — still "version": "2.2.8"
  • .claude-plugin/marketplace.json:51 (the bitwarden-atlassian-tools entry) — still "version": "2.2.8"
  • plugins/bitwarden-atlassian-tools/CHANGELOG.md:8 — latest entry is ## [2.2.8] - 2026-07-01 (about pnpm); no entry for this skill

Adding a backward-compatible feature is a MINOR bump: 2.2.82.3.0.

Remediation:

echo "y" | ./scripts/bump-plugin-version.sh bitwarden-atlassian-tools 2.3.0

(updates plugin.json + marketplace.json; no AGENT.md files exist). Then add to CHANGELOG.md under a new ## [2.3.0] - <date> / ### Added heading, e.g.:

Added evaluating-qa-readiness skill that checks a Jira ticket for the information QA needs before testing (testing instructions, implementation notes, feature-flag state, acceptance criteria, affected clients, linked PR/build) and drafts a developer ask for any gaps.

After bumping, re-run ./scripts/validate-plugin-structure.sh bitwarden-atlassian-tools and ./scripts/validate-marketplace.sh bitwarden-atlassian-tools to confirm name/version consistency.


🟠 Major (should fix)

2. Skill description is over-lengthSKILL.md:3
The description field is ~817 characters, roughly 60% over the ~500-char guideline. The trigger phrases and proactive-use clause are excellent and should stay; the tail that re-enumerates every criterion (feature flag state, testing instructions, implementation notes, acceptance criteria...) duplicates the SKILL.md body and belongs there, not in the description. A description's job is triggering, not summarizing the workflow.

Remediation: Trim to trigger phrases + one-line purpose + proactive clause (~500 chars); drop the criterion enumeration, which is already in the body.


🟡 Minor (optional)

3. Occasional second-person phrasing in Step 2SKILL.md:24-28
Phrases like "you gathered" / "you need both" break from the otherwise consistent imperative voice. Acceptable and idiomatic; tighten only if convenient.

4. Criteria summary duplicates the referenceSKILL.md:32-42 vs references/criteria.md
The inline blocking/non-blocking summary intentionally aids the workflow and is short enough to justify keeping. No change needed, but keep the two copies in sync on future edits.


✅ Passing checks

Plugin structure (plugin-validator)

  • plugin.json valid JSON; name kebab-case, version valid semver, description/author/keywords well-formed; no unknown fields.
  • New skill sits correctly under auto-discovered skills/; SKILL.md at skill root; examples/ and references/ present.
  • Frontmatter name: evaluating-qa-readiness matches the directory exactly; both required fields present.
  • Both referenced files resolve and exist: references/criteria.md (SKILL.md:30), examples/sample_evaluation.md (SKILL.md:93-95).
  • .mcp.json untouched and sane — stdio type, secrets injected via ${VAR} env interpolation, ${CLAUDE_PLUGIN_ROOT} used for portability.

Skill quality (skill-reviewer)

  • Word counts in ideal range: SKILL.md body ~1,140 words (target 1,000–3,000); criteria.md 762; sample_evaluation.md 519.
  • Textbook progressive disclosure: lean core workflow, detailed criterion definitions in references/, complete worked example in examples/, both pointed to from the core.
  • Trigger phrases are concrete, quoted, and varied → reliable auto-invocation. Third-person/imperative form is correct.
  • Strong "Boundaries and honesty" section (read-only MCP, no fabrication, don't trust ticket status as evidence).

Security (reviewing-claude-config)

  • No committed secrets, API keys, tokens, or passwords in any of the three files.
  • No settings.local.json, settings files, or permission/auto-approval changes in this PR.
  • Only credential-adjacent matches are descriptive product-feature references ("master-password reprompt", "reset-password step") — documentation, not secrets.

Bottom line

The new skill is well-designed, secure, and ready on its own merits. Blocking issue: add the 2.3.0 version bump (plugin.json + marketplace.json) and a matching CHANGELOG.md entry in this PR. Recommended: trim the over-length description. Everything else is optional polish.

@prograhamming prograhamming added the ai-review Request a Claude code review label Aug 6, 2026
@prograhamming
prograhamming marked this pull request as ready for review August 6, 2026 21:07
@prograhamming
prograhamming requested a review from a team as a code owner August 6, 2026 21:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ai-review Request a Claude code review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant