prompt-engineer-toolkit · borghei — Claude Code skill for prompt testing
The prompt-engineer-toolkit Claude Code skill tests production prompts and scores model outputs. Use it to compare revisions, investigate regressions, and gate prompt changes before release.
LicenseRef-MIT-Commons-Clause 106 installs ★ 1,183 updated 2026-11-08
npx skills add borghei/Claude-Skills --skill prompt-engineer-toolkit -a claude-codeWhat prompt-engineer-toolkit does
The skill treats prompts as versioned artifacts: build an evaluation suite, inspect prompt text, compare revisions, and score model responses. The toolkit includes prompt_analyzer.py, prompt_diff.py, and eval_scorer.py.
Evaluation cases compare actual outputs with contains, regex, or exact expectations. Set a score threshold with --fail-under; the scorer exits with code 1 when results fall below it. The analyzer and diff use text heuristics, so they cannot tell whether a prompt succeeds at its task. The evaluation suite does that.
What it helps with
- catch regressions in a revised production prompt
- compare two prompt versions and flag risky edits
- score model outputs against an evaluation suite
- spot vague wording and unnecessary prompt instructions
Example prompts for the agent
- Analyze
assets/prompt_v1.txtand flag vague wording or unnecessary instructions. - Compare
assets/prompt_v1.txtwithassets/prompt_v2.txtand report risky changes. - Score the outputs in
assets/sample_eval_suite.jsonusing--fail-under 0.9.
How to install prompt-engineer-toolkit
1Skills CLI (Vercel)
npx skills add borghei/Claude-Skills --skill prompt-engineer-toolkit -a claude-code2Manually: put the files in place
~/.claude/skills/prompt-engineer-toolkit/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/prompt-engineer-toolkit/
1Skills CLI (Vercel)
npx skills add borghei/Claude-Skills --skill prompt-engineer-toolkit -a codex2Manually: put the files in place
.agents/skills/prompt-engineer-toolkit/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add borghei/Claude-Skills --skill prompt-engineer-toolkit -a cursor2Manually: put the files in place
.cursor/skills/prompt-engineer-toolkit/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install borghei/Claude-Skills engineering/prompt-engineer-toolkit/SKILL.md2Manually: put the files in place
.github/skills/prompt-engineer-toolkit/SKILL.md1Skills CLI (Vercel)
npx skills add borghei/Claude-Skills --skill prompt-engineer-toolkit -a gemini-cli2Platform CLI
gemini skills install https://github.com/borghei/Claude-Skills --path engineering/prompt-engineer-toolkitManually: put the files in place
.devin/skills/prompt-engineer-toolkit/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add borghei/Claude-Skills --skill prompt-engineer-toolkit -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about prompt-engineer-toolkit
How do I install prompt-engineer-toolkit in Claude Code?
Run npx skills add borghei/Claude-Skills --skill prompt-engineer-toolkit -a claude-code. The skill file is at ~/.claude/skills/prompt-engineer-toolkit/SKILL.md.
What does prompt-engineer-toolkit do?
It helps test prompts, compare revisions, and score model responses against an evaluation suite. It also checks prompt text for common wording issues.
How does it check that a prompt change meets the baseline?
Run eval_scorer.py with --fail-under <baseline>. The new version must meet or exceed that score without adding failures on format checks.
Similar skills
All skills for AI and ML →prompt-engineer-toolkit by other authors comes first.