Skip to main content
skill CX Codex

experiment-claim-audit — Claude Code skill: audit paper claims

experiment-claim-audit is a Claude Code skill that checks paper numbers, comparisons, and scope claims against raw results. Run it before submission to verify reported values.

no license ★ 240 updated 2026-09-18

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add franklee16/academic-research-skills --skill experiment-claim-audit -a claude-code
Open on GitHub

What experiment-claim-audit does

This skill gathers the paper’s .tex files together with raw result data such as .json, .jsonl, .csv, and .tsv files. A fresh paper reviewer then compares each quantitative or comparative statement with the evidence, without receiving experiment summaries, prior audits, or conversation history.

The audit checks rounding, cherry-picked seeds, mismatched experiment settings, incorrect run counts, arithmetic errors in relative gains, caption-table conflicts, and claims that exceed the tested scope. It produces PAPER_CLAIM_AUDIT.md and PAPER_CLAIM_AUDIT.json with a status for each claim. The paper .tex files and raw result files must be available for the comparison to work.

What it helps with

  • match paper numbers to raw result files
  • catch an incorrect improvement percentage
  • check whether a best seed was reported as an average
  • compare settings across experimental methods
  • flag claims that exceed the evaluation scope

Example prompts for the agent

  • Audit every number in paper/main.tex against the raw experiment files.
  • Compare the paper’s tables and captions with the result files and report any mismatch.
  • Run the claim audit before submission and write PAPER_CLAIM_AUDIT.md.

How to install experiment-claim-audit

1Skills CLI (Vercel)

npx skills add franklee16/academic-research-skills --skill experiment-claim-audit -a claude-code

2Manually: put the files in place

~/.claude/skills/experiment-claim-audit/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/experiment-claim-audit/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about experiment-claim-audit

How do I install experiment-claim-audit in Claude Code?

Run npx skills add franklee16/academic-research-skills --skill experiment-claim-audit -a claude-code, then use ~/.claude/skills/experiment-claim-audit/SKILL.md.

What does experiment-claim-audit do?

It checks each number, comparison, and scope claim in a paper against raw experiment evidence. The review runs with a fresh context that excludes executor summaries and earlier audit results.

Which files does the audit need?

It uses the paper’s .tex files, raw result files such as .json, .jsonl, .csv, or .tsv, and experiment configuration files when settings must be compared.

Similar skills

All skills for Science and research →

From the same set98

The whole set →
02a-empirical-reality-check 02a-empirical-reality-check audits real-world market assumptions prior to economic modeling, validating institutional claims against live web sources. GP ChatGPT ★ 240repo stars 10-manuscript-skeleton The 10-manuscript-skeleton prompt turns earlier economics research outputs into a manuscript outline, covering the abstract, model, results, proofs, discussion, and revisions. GP ChatGPT ★ 240repo stars paper-reviewer paper-reviewer — a reviewer subagent for a co-mathematician setup. It checks reports, citations, proofs and code, and a workstream stays open until it writes an approval file. CX Codex ★ 240repo stars fred-economic-data fred-economic-data pulls economic time series from the FRED API into Claude Code, including GDP, inflation rates, and payroll numbers. CX Codex +1 ★ 240repo stars nature-story nature-story — a skill that transforms raw research ideas into rigorous scientific narratives with competing hypotheses, literature benchmarks, and figure-driven paper plans. CX Codex +1 ★ 240repo stars referee-report Draft or audit referee reports for economics and finance papers. Use it to assess a paper’s contribution and distinguish publication-critical issues from optional suggestions. CX Codex +1 ★ 240repo stars compiledeck compiledeck — a Claude skill that builds and edits LaTeX Beamer decks under hard rules: one point per slide, large type, titles that state the claim. CX Codex +1 ★ 240repo stars glance glance is a Claude Code skill that quickly scans batches of research papers and generates a structured Chinese-language summary PDF with WeasyPrint. CX Codex +1 ★ 240repo stars

Project sponsors

Companies that keep this analytics open