heretic — Claude Code skill: what it does, how to install
The heretic skill runs directional ablation and refusal analysis on open-weight models. Use it to study refusals or reduce benign over-refusal without fine-tuning.
AGPL-3.0-or-later 143 installs ★ 61 updated 2026-11-19
npx skills add akillness/jeo-skills --skill heretic -a claude-codeWhat heretic does
heretic estimates refusal directions from model activations, then alters attention and MLP projection matrices with directional ablation. An Optuna optimizer searches for settings that reduce refusals while keeping the candidate close to the original under KL divergence. It does not perform training or post-training.
The skill supports model ablation, candidate evaluation, and residual-geometry research. Residual plots need the heretic-llm[research] extra, while model and dataset discovery is routed through the scrapling skill. Use it only with open-weight models you have the right to modify.
The runtime requires Python 3.10+ and PyTorch 2.2+; MXFP4 models such as gpt-oss require PyTorch 2.6+. A CUDA GPU is strongly recommended, and bitsandbytes can provide 4-bit quantization for larger models.
What it helps with
- reduce benign refusals in an open-weight model
- measure refusals and KL divergence
- inspect refusal-direction geometry
- generate residual-geometry plots
- fit ablation to available VRAM
Example prompts for the agent
- Reduce benign refusals in
Qwen/Qwen3-4B-Instruct-2507without running training. - Evaluate
p-e-w/gemma-3-12b-it-hereticagainst its original model using refusal and KL metrics. - Print residual geometry and create the per-layer plots.
How to install heretic
1Skills CLI (Vercel)
npx skills add akillness/jeo-skills --skill heretic -a claude-code2Manually: put the files in place
~/.claude/skills/heretic/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/heretic/
1Skills CLI (Vercel)
npx skills add akillness/jeo-skills --skill heretic -a codex2Manually: put the files in place
.agents/skills/heretic/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add akillness/jeo-skills --skill heretic -a cursor2Manually: put the files in place
.cursor/skills/heretic/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install akillness/jeo-skills .agent-skills/heretic/SKILL.md2Manually: put the files in place
.github/skills/heretic/SKILL.md1Skills CLI (Vercel)
npx skills add akillness/jeo-skills --skill heretic -a gemini-cli2Platform CLI
gemini skills install https://github.com/akillness/jeo-skills --path .agent-skills/hereticManually: put the files in place
.devin/skills/heretic/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add akillness/jeo-skills --skill heretic -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about heretic
How do I install heretic in Claude Code?
Run npx skills add akillness/jeo-skills --skill heretic -a claude-code, then check ~/.claude/skills/heretic/SKILL.md.
What does heretic do?
It applies directional ablation to an open-weight model to reduce refusals, then compares the result with the original using refusal and KL-divergence metrics. It can also inspect and plot residual geometry.
What does heretic require to run?
You need Python 3.10+ and PyTorch 2.2+. MXFP4 models such as gpt-oss need PyTorch 2.6+, and a CUDA GPU is strongly recommended.