Skill Audit Loop

⚠️ This repository is deprecated as of 2026-05-18.

The Skill Audit Loop — audit, improve, evaluate, evolve operations plus all source code, graders, eval fixtures, and shared utilities — has been consolidated into @skill-graph/cli (v0.5.6 onward). This repository is preserved as a docs-only mirror for historical reference and inbound-link stability. It is not archived — links into the README, SKILL_AUDIT_LOOP.md, and SKILL_AUDIT_CHECKLIST.md here continue to resolve, but source files (src/, evals/, shared/, package.json) have moved.

See ADR 0009 — Sibling Repo Deprecation for the consolidation rationale, and SH-6132 for the original decision.

The shape (preserved here for reference)

read  →  fix  →  test  →  next

Operation	What it does	Writes to skill frontmatter
audit	Read every field, check against repo truth	last_audited, audit_verdict, lint_verdict, drift_status
improve	Edit one field, one commit, time-boxed	chosen field + last_changed
evaluate	Run the eval suite (LLM grader)	eval_score, eval_failed_ids, freshness
evolve	Loop the above over the corpus	all of the above, per skill

State lives in the skill's own frontmatter — the audit_state Health Block introduced in Skill Metadata Protocol v6. No log-file crawl required.

Quick start (consolidated CLI)

# Install the consolidated package
npm install -g @skill-graph/cli

# Audit a single skill
skill-graph audit my-skill

# Audit with graded dimensions (seven LLM-graded scores)
skill-graph audit my-skill --graded

# Improve one field — auto-tests and keeps or reverts based on eval_score delta
skill-graph improve my-skill --field mental_model

# Evaluate a skill
skill-graph evaluate my-skill

# Evolve the corpus — audit + improve + evaluate, prioritised by staleness
skill-graph evolve --top 10

# Show the Health Block at a glance
skill-graph status my-skill

For the full command reference, see @skill-graph/cli on npm or jacob-balslev/skill-graph.

Where to find the canonical content

You're looking for…	Canonical home
Install the audit CLI	npm install -g @skill-graph/cli → npm
The full audit procedure spec	docs/SKILL_AUDIT_LOOP.md in skill-graph
The per-skill audit checklist	docs/SKILL_AUDIT_CHECKLIST.md in skill-graph
Audit source code	scripts/ in skill-graph
The Health Block field definitions	docs/SKILL_METADATA_PROTOCOL.md in skill-graph
Eval fixtures and baselines	evals/ in skill-graph
Architecture Decision Records	docs/adr/ in skill-graph

What's still here

The two procedure documents below remain as historical snapshots. The authoritative versions are in skill-graph — links above. Treat the copies here as frozen at the deprecation point (2026-05-18, commit 9ceea1f) and not subject to further updates.

File	Status
SKILL_AUDIT_LOOP.md	Historical snapshot of the audit procedure. Canonical: skill-graph/docs/SKILL_AUDIT_LOOP.md.
SKILL_AUDIT_CHECKLIST.md	Historical snapshot of the per-skill checklist. Canonical: skill-graph/docs/SKILL_AUDIT_CHECKLIST.md.
CHANGELOG.md	Historical npm version history for @skill-graph/audit 0.1.0 → 0.3.0. Subsequent releases ship as @skill-graph/cli.

The Skill Graph ecosystem

Repo	Status	Purpose
skill-graph	active	Canonical home — protocol spec, schemas, CLI, lint, manifest, router, drift, audit loop, export
skills	active	Public open-source skill library
skill-metadata-protocol	mirror	Historical docs-only mirror of the normative spec
skill-audit-loop (this repo)	mirror	Historical docs-only mirror of the audit procedure

Contributing & Trust

This repo is read-only. To contribute to the active project:

• Issues, PRs, discussions → file against jacob-balslev/skill-graph.
• Security — report vulnerabilities privately via the security policy, not as public issues.
• Code of Conduct — this project follows the Contributor Covenant 2.1.
• License — Apache-2.0.