Skip to content

ci: enforce the first-party skill authoring rules - #681

Merged
devantler merged 1 commit into
mainfrom
claude/skill-authoring-checks-678
Nov 10, 2026
Merged

devantler merged 1 commit into
mainfrom
claude/skill-authoring-checks-678

Conversation

@devantler

Copy link
Copy Markdown
Contributor

Why

The rules for writing our own skills were written down, but four of them were only kept when an author remembered. A skill that breaks them costs every session: an over-long description is loaded each time, and a reference nobody links is never read.

What

Every pull request now checks our own skills for references that are nested or not linked from the entry file and for descriptions over the agreed length, and reports each description's length. The five places that do not meet the rules today are recorded with a reason and tracked separately, and that record can only shrink.

Fixes #678

🤖 Generated with Claude Code

Add check-skill-authoring.sh for skills authored in this repository:
references sit one level deep, every Markdown reference is linked from
the entry file, a worked example is linked from the entry file or the
reference that explains it, and the description stays within 600
characters. Exceptions are recorded with a reason and can only shrink.

Self-test the new check, add the missing failing cases for the existing
500-line / 20000-byte entry-file budget, run both in CI and describe
them in the lifecycle and validation guides.

Part of #678

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
@devantler

Copy link
Copy Markdown
Contributor Author

🤖 Generated by the Agentic Engineer

@coderabbitai review

@devantler

devantler commented Nov 10, 2026 •

Copy link
Copy Markdown
Contributor Author

🤖 Generated by the Agentic Engineer (interactive Claude Code session)

User trial at 6a4210362e5e12176bf427a5d423da9fcf860004

I used the check the way an author meets it, on a scratch copy of this head:

  • As shipped it passes and lists all 18 first-party skills with their description lengths.
  • I added a reference file to a first-party skill and did not link it. The check failed and named the file. After I linked it from the entry file, the check passed again.
  • I put a reference in a sub-folder. The check failed and said to move it one level up.
  • I lengthened a description from 585 to 642 characters. The check failed with both numbers and said where an exception is recorded.
  • I added an unlinked reference to an external skill. The check passed: external skills are not judged.

The self-test covers the rest (41 cases), including the exception record only shrinking. I also broke the check in four ways (no code-fence handling, counting bytes, ignoring unused exceptions, no nesting rule) and the self-test caught each one. In CI at this head, the new step and its self-test both ran and passed, along with the three new cases for the existing entry-file size limit.

Two things this change does not do, both recorded: the five existing exceptions are tracked in #680, and the acceptance-scenario check is handed to #651, which decides where scenarios live.

🤖 Generated with Claude Code

@coderabbitai

coderabbitai Bot commented Nov 10, 2026 •

Copy link
Copy Markdown
Action not completed

Review rate limited.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

@coderabbitai

coderabbitai Bot commented Nov 10, 2026

Copy link
Copy Markdown

Warning

Review limit reached

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Next included review available in 56 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

Learn how review limits work.

Review configuration:

Run configuration

  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Organization UI
  • Review profile: ASSERTIVE
  • Plan: Advanced
  • Run ID: 8b5bb3ac-941e-4634-bc1e-6acf98afbef2
Commits

Reviewing files that changed from the base of the PR and between eb6d31f and 6a42103.

Files selected for processing: 9

  • .github/workflows/ci.yaml
  • docs/scripts.md
  • docs/skill-lifecycle.md
  • docs/validation.md
  • scripts/check-skill-authoring.sh
  • scripts/check-skill-authoring.test.sh
  • scripts/ci-script-test-sharding-workflow.test.sh
  • scripts/skill-authoring-exceptions.json
  • scripts/validate-manifests.test.sh

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

@devantler

Copy link
Copy Markdown
Contributor Author

🤖 Generated by the Agentic Engineer

@codex review

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Nov 10, 2026 •

Copy link
Copy Markdown
Codex Review Summary: ✅ Completed

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-11-10T23:55:12.674819Z 6a42103 Manual request
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Breezy!

Reviewed commit: 6a4210362e

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@devantler
devantler marked this pull request as ready for review November 10, 2026 23:57
@devantler
devantler merged commit f3dd18e into main Nov 10, 2026
24 checks passed
@devantler
devantler deleted the claude/skill-authoring-checks-678 branch November 10, 2026 23:58
@github-project-automation github-project-automation Bot moved this from 🫴 Ready to ✅ Done in 🌊 Project Board Nov 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: ✅ Done

Development

Successfully merging this pull request may close these issues.

Enforce the first-party skill authoring rules in CI

1 participant