Skip to main content
skill CX Codex

ce-retune — Claude Code skill: what it does, how to install

Retunes a skill corpus for a new model through measurement: a baseline from the run archive, a noise floor, an adversarial audit, then cut passes until a bar registered up front clears.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add EveryInc/compound-engineering-plugin --skill ce-retune -a claude-code
Open on GitHub

What ce-retune does

A corpus that degrades on a new model is a measurement problem first. ce-retune starts there. It mines per-run logs from the archive for a baseline, then runs the harness against two identical copies of the corpus on the same commit to get a noise floor. The bar gets written down before anyone edits a file, because a bar picked after the results are in cannot hold.

The audit runs both directions: one agent per skill proposes cuts, a second defends the prose already there. Those passes need separate contexts. Cuts land one problem per agent, with a measured pass between them. A string pinned by a test is reported, never deleted to turn a suite green. Same care with stops. Some workflows exist to stop and ask, and that is the product.

None of it runs without a harness that can A/B two builds of the corpus: a --plugin-dir-style override or a configurable skills path, plus a repeatable task the corpus actually finishes. Without that the skill halts and names what to build. So the stand comes first, the rewriting second. The target is the registered bar, not a smaller word count.

What it helps with

  • mine a baseline from the run archive before spending a run
  • establish a noise floor from two identical corpus copies
  • register the bar in writing before any edit exists
  • audit each skill with a cutting agent and a defending agent
  • sort halt sites by taxonomy before cutting any stop

Example prompts for the agent

  • Run ce-retune for the new model, corpus at ./skills, bar:<n> consecutive clean runs.
  • Use ce-retune and tell me what the measurement gate is missing before we touch anything.
  • The corpus stalls on the new model — start ce-retune with that symptom, corpus at ./skills.

How to install ce-retune

1Skills CLI (Vercel)

npx skills add EveryInc/compound-engineering-plugin --skill ce-retune -a claude-code

2Manually: put the files in place

~/.claude/skills/ce-retune/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/ce-retune/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about ce-retune

How do I install ce-retune in Claude Code?

Run npx skills add EveryInc/compound-engineering-plugin --skill ce-retune -a claude-code. The skill lands at ~/.claude/skills/ce-retune/SKILL.md.

What does ce-retune do?

It retunes a skill corpus for a new model by measurement: baseline from the archive, noise floor, adversarial audit, then surgical cut passes until a bar registered before any change clears.

Why does ce-retune refuse to run?

It needs a run archive with tool-call traces and token counts, a build selector so two corpus builds are comparable under one runner, and a repeatable task. Missing any of the three, it stops and says what to build.

Source text

SKILL.md · MIT
---
name: ce-retune
description: "Retune a skill corpus for a new model, measurement-first: mine the run archive for a baseline, establish a noise floor, audit the corpus adversarially, then cut in measured passes until a pre-registered bar clears. Requires a benchmark harness that can A/B two builds of the corpus; refuses without one."
disable-model-invocation: true
argument-hint: "[target model or symptom] [path to the corpus, defaults to ./skills] [bar:<n> consecutive clean runs]"
---

# Retune a Corpus for a New Model

A corpus that degrades on a new model is a measurement problem before it is a writing problem: rewriting what looks wrong produces a plausible fix list and no way to know whether any item mattered.

**Outcome:** a corpus whose measured behavior on the target model clears a bar registered before any change, with the regression classes removed and each removal attributable.

**Done:** the bar is cleared, or the run reports the specific claim it could not support. A green test suite is not done: it proves nothing broke, not that behavior improved.

**Non-goal:** word reduction. Leanness and performance are separate programs that share a corpus; only one of them is the result here. Report completion, not word count.


## Phase 0: the measurement gate — check this first

This skill cannot run without a way to observe behavior. Check for all three, and name whichever is missing:

1. **A run archive or a harness that produces one** — per-run logs carrying the tool-call trace, a terminal marker, token counts, and the final message.
2. **A build selector** — the harness can point a run at a specific source checkout of the corpus (a `--plugin-dir`-style override, a configurable skills path, an env var), so two builds are comparable under one runner.
3. **A repeatable task** the corpus actually executes end to end.

If any is missing, **stop and say so**, naming what to build. Do not fall back to a static audit and present it as retuning: an audit can say what looks cuttable and never whether cutting helped. An audit-only pass is a legitimate thing to want; it is a different request.

State the target model and the harness you found before continuing.

## The phases

They run in order, and each names the reference it cannot start without. Read `references/workflow-shapes.md` before dispatching any phase: the wrong orchestration shape is the common failure. Fan out by disjoint file ownership, never by item. Items cross files, and agents that share a file lose each other's edits.

Before assessing whether the registered bar is met or interpreting its results, read `references/noise-floor.md`.

1. **Mine the archive** before spending a run — `references/baseline-mining.md`. Historical runs are a free baseline, usually larger than any experiment affordable now.
2. **Establish the noise floor** — `references/noise-floor.md`. Run the harness against **two identical copies** of the corpus, same commit on both sides; whatever difference appears is the floor every later claim must clear. **Register the bar now, in writing, before any change exists.** A bar chosen after seeing results is not a bar.
3. **Audit the corpus adversarially** — `references/corpus-audit.md`. One agent per skill proposes cuts; a second per skill does the opposite and defends the existing prose. **The two passes require independent contexts.** If the host exposes no way to run them as separate agents, report that as a blocker and stop the audit — do not argue both sides in one context and present the result as an audit.
4. **Cut in surgical passes**, one problem per agent — `references/cut-passes.md`, and `references/halt-taxonomy.md` when the symptom is stalling, halting, or a run that ends while naming work it did not do. Two rules bound every pass, whatever class it is cutting. **Never edit a test to make a suite green**: a removed string a test pins is a finding to report, not a test to weaken. And **not every stop is the enemy.** Some workflows exist to stop and ask; that is the product. Sort every stop by who is actually on the other side before touching it. `references/halt-taxonomy.md` carries the screens that decide, so read them before cutting any stop.
5. **Measure, then let the failure choose the next fix** — `references/cut-passes.md` again for what each failure site means and for auditing the phases the instrument never enters. Loop 4 and 5 until the registered bar clears. Then stop; a bar cleared is done. Also report what stayed unmeasured: a cleared bar never implies coverage it does not have.
6. **Ship** — `references/cut-passes.md` carries what the commits and the write-up must preserve.

© EveryInc · MIT · EveryInc/compound-engineering-plugin

Similar skills

All skills for Agent setup: memory, context, orchestration →

From the same set34

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor