ai-eval-playbook — Claude Code skill for AI evaluation
ai-eval-playbook is a Claude Code skill for assessing AI tools, chatbots, and GenAI products. It comes into play when a team needs evaluation measures or a review of an AI tool proposal.
no license 118 installs ★ 3 updated 2026-10-23
npx skills add gasserane/personal-skills --skill ai-eval-playbook -a claude-codeWhat ai-eval-playbook does
The skill frames product evaluation across four levels: model, product, user, and impact. Its scope includes minimum viable evaluations, golden datasets, LLM-as-judge methods, engagement measures, and guardrail metrics.
Before giving a substantive answer, it requires fetching the current playbook from https://eval.playbook.org.ai/. The fetch options include WebFetch and ctx_fetch_and_index, with claude-in-chrome as a fallback. It does not cover programme or MEL evaluation design, or AI used as an evaluator’s working tool.
What it helps with
- choose an evaluation level for an AI product
- select measures for a chatbot evaluation
- appraise an AI tool proposal
Example prompts for the agent
- How should we evaluate this AI tool?
- Which measures should we track for this chatbot?
- Review this partner’s AI tool proposal and outline an evaluation.
How to install ai-eval-playbook
1Skills CLI (Vercel)
npx skills add gasserane/personal-skills --skill ai-eval-playbook -a claude-code2Manually: put the files in place
~/.claude/skills/ai-eval-playbook/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/ai-eval-playbook/
1Skills CLI (Vercel)
npx skills add gasserane/personal-skills --skill ai-eval-playbook -a codex2Manually: put the files in place
.agents/skills/ai-eval-playbook/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add gasserane/personal-skills --skill ai-eval-playbook -a cursor2Manually: put the files in place
.cursor/skills/ai-eval-playbook/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install gasserane/personal-skills skills/ai-eval-playbook2Manually: put the files in place
.github/skills/ai-eval-playbook/SKILL.md1Skills CLI (Vercel)
npx skills add gasserane/personal-skills --skill ai-eval-playbook -a gemini-cli2Platform CLI
gemini skills install https://github.com/gasserane/personal-skills --path skills/ai-eval-playbookManually: put the files in place
.devin/skills/ai-eval-playbook/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add gasserane/personal-skills --skill ai-eval-playbook -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about ai-eval-playbook
How do I install ai-eval-playbook in Claude Code?
Run npx skills add gasserane/personal-skills --skill ai-eval-playbook -a claude-code. The skill file is at ~/.claude/skills/ai-eval-playbook/SKILL.md.
What does ai-eval-playbook do?
It helps assess AI models and products across four levels, from model performance to impact. It covers evaluation measures, test datasets, and safeguards.
What does ai-eval-playbook need to work?
Substantive answers require fetching the current guide from https://eval.playbook.org.ai/. The skill lists WebFetch, ctx_fetch_and_index, and claude-in-chrome as ways to retrieve it.