Skip to main content
skill CX Codex

skill-integration-tester — Claude Code skill: install

Checks multi-skill workflows in CLAUDE.md for missing skills, JSON contract mismatches and file naming issues. Use it after changing outputs or before release.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add tradermonty/claude-trading-skills --skill skill-integration-tester -a claude-code
Open on GitHub

What skill-integration-tester does

This skill walks through multi-skill workflows defined in CLAUDE.md. It maps each displayed step name to a skill directory, checks handoffs between consecutive steps, and flags file naming violations.

Run scripts/validate_workflows.py across all workflows or target one by a name substring. With --dry-run, it creates synthetic JSON fixtures in reports/fixtures/ and checks contracts without real data. JSON and Markdown reports in reports/ show step results, handoff status, and workflow status.

Python 3.9+ is required; no API key or third-party Python package is needed. The skill reads SKILL.md and CLAUDE.md without modifying them, so it fits a pull request check for changes to skill scripts.

What it helps with

  • verify that workflow skills exist
  • check JSON schema compatibility between steps
  • find broken data handoffs
  • detect file naming violations
  • test contracts with synthetic fixtures

Example prompts for the agent

  • Validate every multi-skill workflow in CLAUDE.md and write the report to reports/.
  • Check the workflow matching Earnings Momentum for broken handoffs.
  • Run a dry check with synthetic JSON fixtures for each workflow step.

How to install skill-integration-tester

1Skills CLI (Vercel)

npx skills add tradermonty/claude-trading-skills --skill skill-integration-tester -a claude-code

2Manually: put the files in place

~/.claude/skills/skill-integration-tester/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/skill-integration-tester/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about skill-integration-tester

How do I install skill-integration-tester in Claude Code?

Run npx skills add tradermonty/claude-trading-skills --skill skill-integration-tester -a claude-code, then run npx skills add tradermonty/claude-trading-skills --skill skill-integration-tester -a claude-code again. The skill file is placed at ~/.claude/skills/skill-integration-tester/SKILL.md.

What does skill-integration-tester do?

It validates workflows in CLAUDE.md for skill existence, JSON contract compatibility, file naming conventions, and handoff integrity. It writes JSON and Markdown reports.

What is required to run it?

It requires Python 3.9+. The script uses the Python standard library and does not require API keys.

Source text

SKILL.md · MIT
---
name: skill-integration-tester
description: Validate multi-skill workflows defined in CLAUDE.md by checking skill existence, inter-skill data contracts (JSON schema compatibility), file naming conventions, and handoff integrity. Use when adding new workflows, modifying skill outputs, or verifying pipeline health before release.
requires_api_key: false
---

# Skill Integration Tester

## Overview

Validate multi-skill workflows defined in CLAUDE.md (Daily Market Monitoring,
Weekly Strategy Review, Earnings Momentum Trading, etc.) by executing each step
in sequence. Check inter-skill data contracts for JSON schema compatibility
between output of step N and input of step N+1, verify file naming conventions,
and report broken handoffs. Supports dry-run mode with synthetic fixtures.

## When to Use

- After adding or modifying a multi-skill workflow in CLAUDE.md
- After changing a skill's output format (JSON schema, file naming)
- Before releasing new skills to verify pipeline compatibility
- When debugging broken handoffs between consecutive workflow steps
- As a CI pre-check for pull requests touching skill scripts

## Prerequisites

- Python 3.9+
- No API keys required
- No third-party Python packages required (uses only standard library)

## Workflow

### Step 1: Run Integration Validation

Execute the validation script against the project's CLAUDE.md:

```bash
python3 skills/skill-integration-tester/scripts/validate_workflows.py \
  --output-dir reports/
```

This parses all `**Workflow Name:**` blocks from the Multi-Skill Workflows
section, resolves each step's display name to a skill directory, and validates
existence, contracts, and naming.

### Step 2: Validate a Specific Workflow

Target a single workflow by name substring:

```bash
python3 skills/skill-integration-tester/scripts/validate_workflows.py \
  --workflow "Earnings Momentum" \
  --output-dir reports/
```

### Step 3: Dry-Run with Synthetic Fixtures

Create synthetic fixture JSON files for each skill's expected output and
validate contract compatibility without real data:

```bash
python3 skills/skill-integration-tester/scripts/validate_workflows.py \
  --dry-run \
  --output-dir reports/
```

Fixture files are written to `reports/fixtures/` with `_fixture` flag set.

### Step 4: Review Results

Open the generated Markdown report for a human-readable summary, or parse
the JSON report for programmatic consumption. Each workflow shows:
- Step-by-step skill existence checks
- Handoff contract validation (PASS / FAIL / N/A)
- File naming convention violations
- Overall workflow status (valid / broken / warning)

### Step 5: Fix Broken Handoffs

For each `FAIL` handoff, verify that:
1. The producer skill's output contains all required fields
2. The consumer skill's input parameter accepts the producer's output format
3. File naming patterns are consistent between producer output and consumer input

## Output Format

### JSON Report

```json
{
  "schema_version": "1.0",
  "generated_at": "2026-03-01T12:00:00+00:00",
  "dry_run": false,
  "summary": {
    "total_workflows": 8,
    "valid": 6,
    "broken": 1,
    "warnings": 1
  },
  "workflows": [
    {
      "workflow": "Daily Market Monitoring",
      "step_count": 4,
      "status": "valid",
      "steps": [...],
      "handoffs": [...],
      "naming_violations": []
    }
  ]
}
```

### Markdown Report

Structured report with per-workflow sections showing step validation,
handoff status, and naming violations.

Reports are saved to `reports/` with filenames
`integration_test_YYYY-MM-DD_HHMMSS.{json,md}`.

## Resources

- `scripts/validate_workflows.py` -- Main validation script
- `references/workflow_contracts.md` -- Contract definitions and handoff patterns

## Key Principles

1. No API keys required -- all validation is local and offline
2. Non-destructive -- reads SKILL.md and CLAUDE.md only, never modifies skills
3. Deterministic -- same inputs always produce same validation results

© tradermonty · MIT · tradermonty/claude-trading-skills

Similar skills

All skills for Agent setup: memory, context, orchestration →

From the same set73

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor