Skip to main content
skill CX Codex

vstack-s4-calibrate-tv — Claude Code skill for trace calibration

The vstack-s4-calibrate-tv Claude Code skill calibrates behavior models and checks them against real traces. It runs stage S4 checks for bugs, fixes, repair components, and reachability witnesses.

MIT ★ 89 updated 2026-11-16

Install into Claude Code · Plugin marketplace All methods and platforms ↓
/plugin marketplace add hao-ai-lab/vstack
/plugin install vstack@hao-ai-lab-vstack
Open on GitHub

What vstack-s4-calibrate-tv does

The skill tests whether a model reproduces the expected bug and whether its fix passes the required checks. It also tests each repair component by removing it and verifies paired reachability witnesses. Stage S4 uses models, configurations, source anchors, and witnesses prepared in S3.

For real traces, it keeps observation, instrumentation, completion, and safety evidence separate, then inspects each NOT_CONSUMED at its first divergence. Clean-baseline counterexamples receive explicit classifications, and results must agree with the coordinator’s clean reruns. A timeout, unknown result, empty exploration, or zero required coverage cannot pass. Property errors go back to S2; models that are too narrow or broad return to S3.

What it helps with

  • check whether a model reproduces the expected bug
  • test a fix and its components against required checks
  • locate the first mismatch between a model and a real trace
  • classify clean-baseline counterexamples and pending reproductions

Example prompts for the agent

  • Run stage S4 on the models, configurations, and witnesses from S3.
  • Check the real traces against the conformance checklist and classify counterexamples.
  • Trace the first NOT_CONSUMED divergence and prepare a rollback with the trace hash, event index, and source anchor.

How to install vstack-s4-calibrate-tv

1Plugin marketplace

/plugin marketplace add hao-ai-lab/vstack
/plugin install vstack@hao-ai-lab-vstack

This installs the whole vstack plugin with all its skills

2Skills CLI (Vercel)

npx skills add hao-ai-lab/vstack --skill vstack-s4-calibrate-tv -a claude-code

3Manually: put the files in place

~/.claude/skills/vstack-s4-calibrate-tv/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/vstack-s4-calibrate-tv/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about vstack-s4-calibrate-tv

How do I install vstack-s4-calibrate-tv in Claude Code?

Add the marketplace with /plugin marketplace add hao-ai-lab/vstack, then install the skill with /plugin install vstack@hao-ai-lab-vstack.

What does vstack-s4-calibrate-tv do?

It calibrates behavior models, tests fixes, and compares model results with real traces. It also classifies mismatches and counterexamples.

What inputs does stage S4 need?

It uses models, configurations, source anchors, and witnesses from S3. Real traces are used for conformance checks.

Source text

SKILL.md · MIT
---
name: vstack-s4-calibrate-tv
description: "Calibrate buggy/fixed/ablated behaviors and validate model conformance using real traces, witnesses and explicit mismatch triage."
---

# S4 — Calibrate and align traces

Read [Layer 0: shared operating rules](../../docs/layer-0.md), this stage and the assigned input bundle.

## Role and write scope

Model and trace workers own distinct outputs; the coordinator consolidates the checklist and independently reruns representatives.

## 1. Input

Models, configurations, source anchors and witnesses from S3.

## 2. Procedure

1. Timestamp predictions. Run four calibration checks: the historical bug violates the expected property by the expected mechanism; the fix completes within bounds; removing each repair component causes a violation; reachability witnesses are reached and their negations fail. Aggregated over the frozen denominator `I_U`, these results give the numerators `Cov_expr` and `Cov_emergent` of the [adequacy readout](../../docs/model-adequacy.md#numerators).
2. Repeat two-sided contract calibration at the minimum scale and one increment above it. A component outside the abstraction is unverified, not a pass.
3. Apply [trace-conformance checklist](../../docs/trace-validation.md) to real traces. Keep observation, instrumentation, completion and safety evidence separate. Report [readout 1](../../docs/model-adequacy.md#readout-1-trace-and-baseline-agreement): `TAR` with its negative-mutant rejection rate, or `TAR = N/A (no trace harness)`, and clean-baseline counterexamples as `Confirmed Bug`, `Model Defect` and `Unjudged (pending repro)` counts.
4. Classify every NOT_CONSUMED at the first divergence; never edit a trace to make it count as accepted.
5. Review every run with [the seven questions](../../docs/run-review.md).

## 3. Exit checks

- Check expected verdicts and mechanisms for the bug, fix, repair ablations and paired witnesses. Generic mechanism and action-coverage automation is missing.
- Supply evidence and state covered and untested scope for every trace checklist item.
- Require agreement with the coordinator's clean reruns. Timeout, unknown, empty exploration and zero required coverage cannot pass.
- Complete S4 even when an S7 proof is planned.

## 4. Rollback

Return a wrong property to S2 and an overly narrow or broad model to S3. Repair instrumentation errors and record new traces within S4. Send real code failures to S6. Carry the trace hash, event index and source anchor. Use [a rollback ticket](../../templates/rollback.md).

## Concrete Examples

A PD slot model can pass its configured safety checks while rejecting a real slot-reuse trace. Diagnose the first divergence before using that model to justify a repair.

© Hao AI Lab · MIT · hao-ai-lab/vstack

Similar skills

All skills for Testing and QA →

From the same set13

The whole set →
vstack The vstack Claude Code plugin gives coding agents a formal workflow for checking state-machine models without weakening their safety properties. Run it on a module and a stated safety requirement. ★ 89repo stars vstack-s1-select The vstack-s1-select Claude Code skill selects verification methods and assurance tiers for system properties. It splits obligations by property and weighs scale, code ownership, and failure impact. CX Codex +1 ★ 89repo stars vstack-s6-hunt-fix The vstack-s6-hunt-fix Claude Code skill searches for bugs within a trace-validated model and checks proposed fixes. It classifies counterexamples and tests changes against real code. CX Codex +1 ★ 89repo stars vstack-s0-decompose vstack-s0-decompose is a Claude Code skill that maps system control, data flow, and boundaries, then builds evidence-backed historical anchors. It runs during analysis of a pinned source revision before verification. CX Codex +1 ★ 89repo stars vstack-mode The vstack-mode Claude Code skill runs staged verification for concurrent, distributed, and systems software. It takes a property from source investigation through proof and regression. CX Codex +1 ★ 89repo stars vstack-s2-spec The vstack-s2-spec Claude Code skill turns a design into testable specifications and pinned checks. It runs during specification work based on an approved S1 design and obligation matrix. CX Codex +1 ★ 89repo stars vstack-s5-redteam The vstack-s5-redteam Claude Code skill probes a model and its gates with independent attacks. It runs at stage S5 to expose weak checks and verify findings against real code. CX Codex +1 ★ 89repo stars vstack-s8-package-maintain The vstack-s8-package-maintain Claude Code skill turns verified project scope into a five-step regression workflow. It handles regression setup and upkeep as code changes. CX Codex +1 ★ 89repo stars

Project sponsors

Companies that keep this analytics open