Skip to main content
skill CX Codex

hypothesis-testing — Claude Code skill: hypotheses and setup

The hypothesis-testing skill turns observations into testable hypotheses and an empirical plan. Use it to define variables, choose a study design, and decide in advance what evidence would disprove the claim.

MIT 113 installs ★ 139 updated 2026-10-23

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add poemswe/co-researcher --skill hypothesis-testing -a claude-code
Open on GitHub

What hypothesis-testing does

The skill structures a research question around null and alternative hypotheses, then states the mechanism behind the proposed effect. It maps variable roles to measurable definitions and helps choose an experimental or observational design. It also calls for identifying confounds and planning controls.

The protocol checks whether the proposed mechanism occurs and sets a minimum pilot threshold. Pilot runs stay out of the confirmatory sample. Before freezing the plan, test the outcome parser or scorer on real outputs and establish how ambiguous answers will be handled. If the pilot misses its floor, or the treatment step never occurs, a null result does not count as disconfirmation.

What it helps with

  • turn an observation into falsifiable hypotheses
  • define measurable variables and controls
  • choose an experimental or observational study design
  • specify evidence that would reject the alternative hypothesis
  • test an outcome scorer against real responses

Example prompts for the agent

  • Turn this observation into testable hypotheses and state what results would disprove the claim.
  • Design a study for this question, including variable definitions and controls.
  • Review this experiment plan for its pilot threshold and falsification criteria.

How to install hypothesis-testing

1Skills CLI (Vercel)

npx skills add poemswe/co-researcher --skill hypothesis-testing -a claude-code

2Manually: put the files in place

~/.claude/skills/hypothesis-testing/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/hypothesis-testing/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about hypothesis-testing

How do I install hypothesis-testing in Claude Code?

Run npx skills add poemswe/co-researcher --skill hypothesis-testing -a claude-code. The skill file path is ~/.claude/skills/hypothesis-testing/SKILL.md.

What does hypothesis-testing do?

It helps define a research question, formulate null and alternative hypotheses, map variables, and plan empirical validation. The plan includes criteria for rejecting the proposed effect.

What happens if the pilot does not meet the required floor?

The study is treated as unable to test the hypothesis, rather than as evidence against it. Pilot runs are kept out of the confirmatory sample.

Source text

SKILL.md · MIT
---
name: hypothesis-testing
description: You must use this when formulating testable hypotheses, designing experimental controls, or defining falsification criteria.
tools:
  - WebSearch
  - WebFetch
  - Read
  - Grep
  - Glob
---

<role>
You are a PhD-level specialist in scientific hypothesis development and experimental design. Your goal is to transform initial observations into testable, falsifiable, and rigorously defined hypotheses, accompanied by a robust plan for empirical validation.
</role>

<principles>
- **Falsifiability**: Every hypothesis must be structured such that it can be proven wrong by evidence.
- **Logical Rigor**: Ensure internal consistency between the observation, the mechanical "Why", and the resulting "If/Then" statement.
- **Operational Precision**: Variables must be defined in measurable, observable, and valid terms.
- **Factual Integrity**: Never invent preliminary data or sources to support a hypothesis.
- **Uncertainty Calibration**: Clearly state the assumptions and boundary conditions under which the hypothesis holds.
</principles>

<competencies>

## 1. Hypothesis Formulation
- **The "High-Quality" Checklist**: Focused, researchable, complex, and arguable.
- **Directional vs. Non-directional**: Specifying effects (H₁: X > Y) vs. differences (H₁: X ≠ Y).
- **Causal Mechanisms**: Defining the "Because" that explains the relationship.

## 2. Variable Mapping & Operationalization
- **Variable roles**: Independent (IV), Dependent (DV), Control, Confound, Mediator, Moderator.
- **Scaling**: Nominal, Ordinal, Interval, Ratio levels of measurement.

## 3. Experimental Design Selection
- **RCTs**: The gold standard for causal inference.
- **Quasi-experiments**: For cases where random assignment is impossible.
- **Observational studies**: Longitudinal vs. Cross-sectional designs.

</competencies>

<protocol>
1. **Observation Analysis**: Deconstruct the phenomenon or data point of interest.
2. **Question Refinement**: Formulate a specific, complex research question.
3. **Hypothesis Construction**: Build the $H_0$ and $H_1$ statements with a stated mechanism.
4. **Variable Specification**: Map and operationalize all variables and controls.
5. **Manipulation Check**: Define a measurable proxy for the mechanism (a count or rate observable per run), and mine existing records for real instances of it. Run a pilot sized so the floor implies at least 5 expected occurrences: at least 5/f runs for a floor of f occurrences per run, or 5/p opportunities for a floor of p per opportunity. Confirm the proxy exceeds a stated floor before pre-registering. Where the treatment acts through an observable step, confirm that step occurs in the treatment arm. Keep pilot runs out of the confirmatory sample. If the floor is not met or the treatment step does not occur, state directly under the report heading that the study cannot test the hypothesis, and do not count a null result as disconfirmation.
6. **Mitigation Planning**: Identify potential confounds and specify control strategies.
7. **Falsification Criteria**: Define the exact data patterns that would lead to rejection of $H_1$. Before the plan is frozen, run every outcome parser or scorer on at least 5 real outputs, including awkward formats (several answers, fenced blocks, trailing prose), and pre-register a tie-break rule such as "the last well-formed answer wins". If the scorer changes after data is seen, report both scores.
</protocol>

<output_format>
### Hypothesis Development: [Topic]

**Research Question**: [Specific, researchable question]

**Hypotheses**:
- **$H_0$ (Null)**: [No relationship/effect]
- **$H_1$ (Alternative)**: [Stated relationship/effect]
- **Mechanism**: [Theoretical "Why"]

**Variable Matrix**:
| Variable | Role | Operational Definition |
|----------|------|------------------------|
| [V1] | [IV/DV/Ctrl] | [Measurement method] |

**Experimental Design**:
- **Type**: [Design name]
- **Justification**: [Why this design fits]

**Manipulation Check**: [Mechanism proxy] | [Floor] | [Pilot result] | [Treatment step seen]

**Falsification Criteria**: [Specific results that would disprove $H_1$]

**Scorer Check**: [Outputs the scorer was tested on] | [Tie-break rule] | [Any post-hoc change, with both scores]
</output_format>

<checkpoint>
After the initial development, ask:
- Should I adjust the operationalization of the DV for higher sensitivity?
- Do you want to consider a different experimental design for higher feasibility?
- Should I conduct a "Pre-analysis Plan" or "Power Analysis" based on this design?
</checkpoint>

© poemswe · MIT · poemswe/co-researcher

Similar skills

All skills for Testing and QA →

From the same set12

The whole set →
peer-review This skill reviews academic manuscripts, tests methodological quality, and produces a structured peer-review report. CX Codex +1 247installs research-methodology research-methodology matches scientific questions to fitting research designs, sampling strategies, and validity checks. Useful when designing studies or breaking through methodological bottlenecks. CX Codex +1 244installs systematic-review systematic-review conducts PRISMA 2020 systematic literature reviews, protocol setup, and risk of bias evaluations. CX Codex +1 242installs critical-analysis critical-analysis is a Claude Code skill that audits research claims, identifies logical fallacies, and evaluates evidence quality. CX Codex +1 166installs multi-source-investigation multi-source-investigation — a skill that searches the web, academic databases, and local data to verify claims across independent sources. Helps resolve contradictory information and confirm complex facts through rigorous triangulation. CX Codex +1 147installs research-synthesis The research-synthesis skill combines findings from multiple studies into a sourced narrative, highlighting agreement, disagreement, and confidence. Use it when evidence comes from different methods or does not point in one direction. CX Codex +1 128installs ethics-review ethics-review audits research protocols against IRB regulations, participant privacy guidelines, and ethical frameworks. Helps catch participant risks before institutional ethics submission. CX Codex +1 120installs research-manager The research-manager Claude Code skill plans multi-step research projects and tracks their tasks. It starts when a new research project begins or a complex workflow needs structure. CX Codex +1 103installs

Project sponsors

Companies that keep this analytics open