skill-improve — Claude Code skill: test-fix-retest loop for your
Runs one skill through a test → fix → retest loop and keeps the edit only when the score drops. Useful when a skill exists but the static test still complains.
npx skills add Donchitos/Claude-Code-Game-Studios --skill skill-improve -a claude-codeWhat skill-improve does
The skill takes a skill name as its argument, checks that .claude/skills/[name]/SKILL.md exists, and runs /skill-test static [name] for a baseline: how many FAILs and WARNs, and which checks failed. If the file cannot be read and the result comes back NOT ASSESSED, it stops — there is no score to improve.
Next it looks up the category: field in studio-tests/catalog.yaml and, when a category is assigned, runs /skill-test category [name] too. Diagnosis names the exact gap behind each failure: a missing frontmatter field, too few phases, no verdict keywords, Write in allowed-tools with no ask-before-write language. Fixes are shown as before/after blocks and touch only what is failing.
Before writing, the skill asks permission and records the current text of every file the fix changes. After the write, a retest measures the new score, and if it did not improve, the skill offers to restore the earlier content. Restore goes through Write, not git checkout — that would return the last committed version and discard uncommitted work. The score is static: it reads the skill instead of running it, so a higher number means better-written text, not better behaviour. Check behaviour separately by running the skill on a real request before and after.
What it helps with
- see which static checks a skill fails
- fix frontmatter and phase structure from the failure list
- compare the score before and after an edit
- restore a file when an edit did not help
- work through the category rubric in
studio-tests/catalog.yaml
Example prompts for the agent
- /skill-improve tech-debt
- /skill-improve skill-improve
- Run
/skill-test staticon my skill and show me what fails
How to install skill-improve
1Skills CLI (Vercel)
npx skills add Donchitos/Claude-Code-Game-Studios --skill skill-improve -a claude-code2Manually: put the files in place
~/.claude/skills/skill-improve/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/skill-improve/
1Skills CLI (Vercel)
npx skills add Donchitos/Claude-Code-Game-Studios --skill skill-improve -a codex2Manually: put the files in place
.agents/skills/skill-improve/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add Donchitos/Claude-Code-Game-Studios --skill skill-improve -a cursor2Manually: put the files in place
.cursor/skills/skill-improve/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install Donchitos/Claude-Code-Game-Studios skill-improve2Manually: put the files in place
.github/skills/skill-improve/SKILL.md1Skills CLI (Vercel)
npx skills add Donchitos/Claude-Code-Game-Studios --skill skill-improve -a gemini-cli2Platform CLI
gemini skills install https://github.com/Donchitos/Claude-Code-Game-Studios --path .claude/skills/skill-improveManually: put the files in place
.devin/skills/skill-improve/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add Donchitos/Claude-Code-Game-Studios --skill skill-improve -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about skill-improve
How do I install skill-improve in Claude?
Run npx skills add Donchitos/Claude-Code-Game-Studios --skill skill-improve -a claude-code. The skill lands in ~/.claude/skills/skill-improve/SKILL.md.
What does skill-improve do?
It runs one skill through a test → fix → retest loop. Changes are kept only when the combined FAIL and WARN count goes down.
What does the skill need to work?
It relies on /skill-test and on studio-tests/catalog.yaml for category checks. If the catalog still sits under the old CCGS Skill Testing Framework/ name, the skill says so and carries on.
Source text
SKILL.md · MIT
---
name: skill-improve
description: "Improve a skill via a test-fix-retest loop — static checks, targeted fixes, keep or revert on score change."
argument-hint: "[skill-name]"
user-invocable: true
allowed-tools: Read, Glob, Grep, Write, Bash(bash "*/.claude/skills/skill-improve/../../hooks/yaml-helper.sh" resolve_config *)
model: sonnet
---
!`bash "${CLAUDE_SKILL_DIR}/../../hooks/yaml-helper.sh" resolve_config --keys automation`
**Automation mode**: Resolve `modes.automation` (`project.local.yaml` →
`project.yaml` → default `collaborative`). Every `AskUserQuestion` call and
every file write follows `.claude/docs/automation-modes.md`
(collaborative asks always · guided major-only · autonomous logs and proceeds;
`automation_always_ask` categories always prompt).
# Skill Improve
Runs an improvement loop on a single skill:
test → fix → retest → keep or revert.
Its score comes from `/skill-test` static and category checks, which read the
skill rather than run it: a better score means a better-written skill, not proof
that it behaves better. To check behaviour, run the skill on a real request
before and after the change.
---
## Phase 1: Parse Argument
Read the skill name from the first argument. If missing, output usage and stop:
```
Usage: /skill-improve [skill-name]
Example: /skill-improve tech-debt
```
Verify `.claude/skills/[name]/SKILL.md` exists. If not, stop with:
"Skill '[name]' not found."
Glob `CCGS Skill Testing Framework/catalog.yaml`. When it exists, say so first:
"`CCGS Skill Testing Framework/` was renamed `studio-tests/` in 1.2.0, and this
skill reads only `studio-tests/`. Move any specs you wrote there; UPGRADING.md
(v1.1.3 → v1.2.0, `studio-tests/`) says how." Then go on.
---
## Phase 2: Baseline Test
Run `/skill-test static [name]` and record the baseline score:
- Count of FAILs
- Count of WARNs
- Which specific checks failed (Check 1–7)
Display to the user:
```
Static baseline: [N] failures, [M] warnings
Failing: Check 4 (no ask-before-write), Check 5 (no handoff)
```
If the static result is **NOT ASSESSED** (the skill file could not be read or
parsed), stop and report it with its reason: there is no score to improve, and
0 FAILs from a file nobody could read is not a clean result.
If baseline is 0 FAILs and 0 WARNs, note it and proceed to Phase 2b.
### Phase 2b: Category Baseline
Look up the skill's `category:` field in `studio-tests/catalog.yaml`.
If no `category:` field is found, display:
"Category: not yet assigned — skipping category checks."
and skip to Phase 3.
If category is found, run `/skill-test category [name]` and record the category baseline:
- Count of FAILs
- Count of WARNs
- Which specific category rubric metrics failed
Display to the user:
```
Category baseline: [N] failures, [M] warnings ([category] rubric)
```
A category result of **NOT ASSESSED** (a rubric section the skill-test could not
find or apply) is reported with its reason and is not a zero: the category
dimension is then excluded from "already passes" below.
If BOTH static and category baselines are 0 FAILs and 0 WARNs — and neither is
NOT ASSESSED — stop:
"This skill already passes all static and category checks. No improvements needed."
---
## Phase 3: Diagnose
Read the full skill: `.claude/skills/[name]/SKILL.md` and every file in its `references/` folder,
if it has one — the longest skills keep each phase there. Name the file each
gap is in.
For each failing or warning **static** check, identify the exact gap:
- **Check 1 fail** → which frontmatter field is missing
- **Check 2 fail** → how many phases found vs. minimum required
- **Check 3 fail** → no verdict keywords anywhere in the skill body
- **Check 4 fail** → Write or Edit in allowed-tools but no ask-before-write language
- **Check 5 warn** → no follow-up or next-step section at the end
- **Check 6 warn** → `context: fork` set but fewer than 5 phases found
- **Check 7 warn** → argument-hint is empty or doesn't match documented modes
For each failing or warning **category** check (if category was assigned in Phase 2b),
identify the exact gap in the skill's text. For example:
- If G2 fails (gate mode, director panel width): skill body does not size the
PHASE-GATE panel from `modes.workflow` (PR at `minimal`, TD + PR at `standard`,
all 4 at `full`)
- If A2 fails (authoring, no per-section May-I-write): skill asks once at the end, not
before each section write
- If T3 fails (team, BLOCKED not surfaced): skill doesn't halt dependent work on blocked agent
Show the full combined diagnosis to the user before proposing any changes.
---
## Phase 4: Propose Fix
Write a targeted fix for each failure and warning. Show the proposed changes
as clearly marked before/after blocks. Only change what is failing — do not
rewrite sections that are passing. In a skill with a `references/` folder, a
fix to a phase's steps goes in that phase's `references/` file, not back into
`SKILL.md`; the question below then names each file the fix changes.
Ask: "May I write this improved version to `.claude/skills/[name]/SKILL.md`?"
If the user says no, stop here.
---
## Phase 5: Write and Retest
Record the current content of each file the fix changes — the exact text, kept
in this conversation — so Phase 6 can restore it.
Write the improved skill to `.claude/skills/[name]/SKILL.md`, and to each
`references/` file the fix changes.
Re-run `/skill-test static [name]` and record the new static score — measured by that run, never stated from the edit.
If a category was assigned, also re-run `/skill-test category [name]` and record the new category score.
Display the comparison:
```
Static: Before [N] failures, [M] warnings → After [N'] failures, [M'] warnings
Category: Before [N] failures, [M] warnings → After [N'] failures, [M'] warnings (if applicable)
Combined: [before] → [after] (improved / no change / worse)
```
`[before]` and `[after]` are the Phase 6 combined counts — failures plus
warnings, both dimensions — e.g. `Combined: 3 → 0 (improved)`.
---
## Phase 6: Verdict
Count the combined failure total: static FAILs + category FAILs + static WARNs + category WARNs.
**A re-test that comes back NOT ASSESSED** (for example, the edit broke the
frontmatter so the file no longer parses) is never an improvement, whatever its
counts: take the "did not improve" branch below.
**If combined score improved (combined failure count is lower than baseline):**
Report: "Score improved. Changes kept."
Show a summary of what was fixed in each dimension.
**If combined score is the same or worse:**
Report: "Combined score did not improve."
Show what changed and why it may not have helped.
Ask: "May I restore `.claude/skills/[name]/SKILL.md` to the content it had before this run?"
— naming every file Phase 5 wrote.
If yes: write the content recorded in Phase 5 back to each file with Write; if no, leave the files as written. Never
`git checkout` it — that returns the last *committed* version and discards any edits
made before this run that were not yet committed.
---
## Phase 7: Next Steps
- Run `/skill-test static all` to find the next skill with failures.
- Run `/skill-improve [next-name]` to continue the loop on another skill.
- Run `/skill-test audit` to see overall coverage progress.
© Donchitos · MIT · Donchitos/Claude-Code-Game-Studios