Skip to main content
skill CX Codex

maintain-formal-verification-skill — Claude Code skill

Checks whether a project’s formal verification still matches changed code, then reruns it and classifies failures. Useful after merges or refactors that bypassed the usual verification workflow.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add backnotprop/pstack --skill maintain-formal-verification-skill -a claude-code
Open on GitHub

What maintain-formal-verification-skill does

The skill locates project checks that use a model checker, prover, or code verifier, then traces what code and properties they cover. It reviews commits since the last confirmed sync and updates the relevant model, harness, or property before rerunning the check. The report separates stale verification from a failure in the current code.

For a passing check, it tests whether the updated verification can still catch a broken property. For a failure, it compares the counterexample with the real code step by step. Edits are limited to verification files and the verify skill itself; product code stays untouched unless the user asks otherwise. A property failure must be reported, not hidden by weakening the check.

What it helps with

  • find formal checks that no longer describe changed code
  • bring a model or harness up to date after a refactor
  • trace a counterexample to verification drift or a code bug
  • test that an updated check still catches a broken property

Example prompts for the agent

  • Run /maintain-formal-verification-skill and check whether the model still matches the current code.
  • After this merge, update the formal checks for the affected code and report the changes.
  • Analyze the failed check, replay its counterexample against the code, and distinguish drift from a bug.

How to install maintain-formal-verification-skill

1Skills CLI (Vercel)

npx skills add backnotprop/pstack --skill maintain-formal-verification-skill -a claude-code

2Manually: put the files in place

~/.claude/skills/maintain-formal-verification-skill/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/maintain-formal-verification-skill/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about maintain-formal-verification-skill

How do I install maintain-formal-verification-skill in Claude Code?

Run npx skills add backnotprop/pstack --skill maintain-formal-verification-skill -a claude-code. The skill file is at ~/.claude/skills/maintain-formal-verification-skill/SKILL.md.

What does maintain-formal-verification-skill do?

It brings project verification back in sync with changed code, reruns checks, and investigates failures. Its report distinguishes stale verification from a bug in the code.

Does the skill fix product code when a property fails?

No. It edits verification artifacts and the verify skill, not product code, unless the user explicitly requests a code change.

Source text

SKILL.md · MIT
---
name: maintain-formal-verification-skill
description: "Bring a project's formal verification back in line with the code after the code changes: find the commits that touched verified code, update the model, harness, or properties to describe the code as it is now, rerun, and say whether each failure is drift in the verification or a bug in the code. Use for /maintain-formal-verification-skill, \"is the model still true to the code\", or after merges and refactors that touched verified code without rechecking it."
disable-model-invocation: true
---

# Maintain a formal verification skill

A formal check proves a property of what it describes. When the code changes and the verification does not, the check can keep passing while it describes code that no longer exists. That pass is the dangerous case, because it looks like a proof. This skill is the upkeep loop for a verify skill that `/create-formal-verification-skill` generated, or for any project-local skill that runs a model checker, prover, or code-level verifier against named code. The project-local skill handles a change that an agent makes while it uses that skill. This skill handles the changes that skipped it: merges, edits made without the skill, and drift that builds up across many commits.

## Outcomes

Give each check one outcome, and say which:

- **in sync**: no change since the last sync alters what the check describes, and the check passes.
- **updated**: the code changed, the verification now describes the new code, and the check passes.
- **bug**: the verification describes the current code, and the code breaks the property. This is a finding about the code. It is not drift.
- **blocked**: the check could not be brought back in line or could not run. Say exactly why.

A check can be both updated and bug: the update makes the verification describe the code again, and then the property fails on it.

## Edit scope

Edit only the verification: models, harnesses, property files, and the verify skill itself. Never edit product code during a run, unless the user asks you to. When a property fails on the current code, do not weaken the property or the model to make it pass. Report the failure.

## Pass

1. **Find the checks.** A verify skill has no fixed name, so find it by what it does: a project skill that runs a model checker, a prover, or another verifier against named code. Read each one you find, or the one the user named. For each check, collect the property, the code it covers, the bounds and assumptions, the command that runs it, and the commit where it was last confirmed to describe the code. If no verify skill exists, stop and point at `/create-formal-verification-skill`. If the skill does not record a sync commit, use the last commit that changed the verification files, and say that you did.

2. **Run it as it is.** Run each check once before you change anything, and record the result. A pass here does not tell you that the code is correct. It tells you that the old description still holds. A failure here can be drift or a bug. Do not decide which until step 5.

3. **Read every change to covered code.** Diff the covered files from the sync commit to the current commit, and read each commit message. Also look for code that moved: a covered function that is renamed, split, or moved to another file is still covered code. Also look for new code that touches the state that a check guards, such as a new function that writes the same fields. For each change, decide which of these it is:
   - **No effect.** The change does not alter anything the verification describes, such as formatting, comments, or code paths that the verification does not cover. Check this against the model or harness, not against the commit message.
   - **The verification no longer describes the code.** A step that was one indivisible action is now two, a branch was added or removed, a check moved, a new path reaches the guarded state, or a value now has a different range. The model or harness must change.
   - **The promise changed on purpose.** The change alters what the code promises, and evidence in the change says that this is intended: the doc comment, the tests, the changelog, or the commit message. The property must change, and you must cite that evidence.
   - **The promise may be broken.** The code changed, and no evidence says that the promise changed. Treat a failure that follows as a bug candidate.

4. **Update from the code, not from the result.** Change the model or harness so that each changed part again points to code that a reviewer can open, and keep one indivisible step in the code as one step in the verification. Write the update from the code before you rerun, and do not shape it by what makes the check pass. Change a property only for a promise that changed on purpose. Write down the old wording, the new wording, and the evidence. Keep the bounds unless the change makes them wrong. If you must reduce a bound, say so in the report.

5. **Rerun and judge each result.**
   - **Pass:** the check can now pass on a description that has lost the ability to fail. Break the new code the way the property guards against, such as removing a new check or reordering a new step, and confirm that the check catches it. Then drop the break.
   - **Fail:** replay the counterexample against the real code, step by step. If a step cannot happen in the code, the verification is wrong. Fix the verification, and say what was wrong. If every step can happen, it is a bug. Name the commit that introduced it, tell the counterexample as a sequence of steps in the code's own words, and state the harm in one sentence. If a cheap test or reproduction against the real code shows the bug, add it to the report as evidence. Do not commit it to the product code.

6. **Update the verify skill.** Update the code that each check covers, the commands, the bounds, the assumptions, and the sync commit. Set the sync commit to the commit that you checked. Do not move the sync commit for a blocked check, and say so in the report. Then follow the verify skill once as the next agent would, so that you know its steps still run.

## Report

Tell the user, for each check:

- the outcome, and the commits that you read;
- what changed in the verification and why, with a short reason for each change: the code changed shape, or the promise changed on purpose (with the evidence);
- the rerun result, and the break that you used to show the updated check can still fail;
- each bug, in plain words: the counterexample as steps in the code's words, the harm, and the commit that introduced it;
- what the verification still does not cover, including new code that it should cover and does not.

Say outright which failures were drift in the verification and which were bugs in the code. For a check that passed before you updated it and fails after, say that the old pass was on a stale description.

Put the verification updates in a change of their own, separate from any product fix.

© backnotprop · MIT · backnotprop/pstack

Similar skills

Everything for Testing and QA →

From the same set44

principle-foundational-thinking A principle set for the stage before logic: pick core types and data structures, order the scaffold, check what concurrent actors share. CX Codex +1 5,100installs correct Finds repeated mistakes made by coding agents and makes them impossible through architecture, types, linters, or tests. Useful when agents keep making the same wrong edits. CX Codex +1 4,200installs benchmark-checklist A skill that makes the agent answer seven questions with evidence from a run before it reports a speedup or a regression. CX Codex +1 4,100installs principle-explain-the-number A skill for the moment before you trust a measured number: name what caps it, then rule out that the test measured something other than your work. CX Codex +1 4,100installs poteto-help Answers questions about pstack: how to set it up, how to run /poteto-mode, which skill fits a task. It hands you a prompt instead of starting work. CX Codex +1 3,700installs ketchup Summarizes chat updates since your last message in plain words and visual diagrams, highlighting decisions that need your approval. CX Codex +1 2,900installs sharpen The skill runs your task through four questions and rewrites the prompt so the work goes deeper instead of wider. CX Codex +1 2,200installs create-formal-verification-skill This skill selects code for formal verification and creates a project-local guide for checking it again after changes. Use it when tests leave important invariants or event orderings uncovered. CX Codex +1 1,200installs

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor