Skip to main content
affpapa.org
RU EN
skill Claude Code CX Codex Cursor GitHub Copilot

ads-test — Claude Code skill: paid-ad A/B tests

Walks a paid-media experiment from hypothesis to readout: randomization unit, sample size, stopping rule, and a plain-language decision.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓ 
npx skills add AgriciDaniel/claude-ads --skill ads-test -a claude-code
Open on GitHub

What ads-test does

The skill takes a paid-ad test through its steps in order. First it pins down the decision, the causal hypothesis, treatment and control, the randomization unit, the population, the primary metric, guardrails, the minimum effect and the stopping rule. Then it checks what the ad platform allows: overlapping tests, conversion lag, seasonality, cross-group interference and whether the measurement holds up.

Sample size and duration come out of assumptions you declare, and the skill asks for the approximations to be stated rather than buried. One decision surface changes at a time unless the design explicitly estimates interactions. Exclusions, quality checks, the analysis plan and decision thresholds get pre-registered before launch, not after.

On readout it verifies assignment integrity and data completeness first, then estimates the effect with its uncertainty. You get versioned JSON and a decision in ordinary words.

The skill also names the habits that ruin these tests: peeking repeatedly and stopping when the number looks good, and calling underpowered noise a winner. Generalising past the tested population is the third. Worth checking your process against all three before the budget goes out.

What it helps with

  • plan an ad A/B test with a stated hypothesis and randomization unit
  • size the sample and duration from declared assumptions
  • pre-register stopping rules and exclusions before launch
  • audit a readout for assignment integrity and data completeness
  • separate an underpowered result from a real lift

Example prompts for the agent

  • Design an A/B test for two creatives: hypothesis, treatment and control, primary metric, sample size and duration from my assumptions.
  • Check this test design for overlapping experiments and conversion lag, then return the setup as JSON.
  • Read out the test: assignment integrity and data completeness first, then the effect with uncertainty.

How to install ads-test

1Skills CLI (Vercel)

npx skills add AgriciDaniel/claude-ads --skill ads-test -a claude-code

2Manually: put the files in place

~/.claude/skills/ads-test/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/ads-test/

From the same set20

The whole set →
ads-meta AgriciDaniel Audits Meta Ads accounts, Pixel, Events Manager, attribution, and creatives. Runs in read-only mode to evaluate Facebook and Instagram campaign health. Claude Code CX Codex Cursor +1 4,700installs ads-google AgriciDaniel Audits Google Ads measurement, settings, Search, Shopping, Performance Max and Demand Gen campaigns. Use it to review account evidence without changing campaigns. Claude Code CX Codex Cursor +1 4,400installs ads-audit AgriciDaniel Paid-ad audit across Google, Meta, YouTube, LinkedIn, TikTok, Microsoft, Apple, Amazon, Reddit, Pinterest, Snapchat and X — JSON bundle first, reports second. Claude Code CX Codex Cursor +1 4,100installs ads-creative AgriciDaniel A skill that reviews ad copy, images, video, hooks, and concepts against platform requirements, accessibility standards, creative fatigue, and brand fit. Use it to determine which creative assets need refresh or testing. Claude Code CX Codex Cursor +1 4,100installs ads-competitor AgriciDaniel Directs your coding agent to inspect competitor paid ads across transparency libraries and landing pages. Clarifies messaging, offers, and creative angles without guesswork. Claude Code CX Codex Cursor +1 4,100installs ads-tiktok AgriciDaniel Audits a TikTok Ads account against a checklist and returns findings as JSON: Pixel, audiences, Smart+, bidding, attribution, policy. It changes nothing. Claude Code CX Codex Cursor +1 4,100installs ads-budget AgriciDaniel Plans and audits paid-media spend, bidding strategies, and pacing across channels. Useful when balancing marginal returns and cash constraints. Claude Code CX Codex Cursor +1 4,000installs ads-plan AgriciDaniel Walks an agent through a paid-media plan: objectives, channel choice, campaign architecture, budget, measurement and rollback terms. Meant for the stage before money hits the ad account. Claude Code CX Codex Cursor +1 4,000installs

Similar

copywriting sickn33 Skill for writing clear, conversion-focused marketing copy for landing pages and emails. Forces you to understand audience and context first, blocks fabricated claims and statistics. Claude Code CX Codex Cursor +1 1,600installs marketing-ideas coreyhaines31 This skill suggests marketing ideas for SaaS and software products based on their stage and available resources. Use it when you need a place to start with growth. Claude Code CX Codex Cursor +1 146,400installs revops coreyhaines31 This skill helps design RevOps workflows for lead stages, scoring, routing, and marketing-to-sales handoffs. Use it when CRM processes need clear rules. Claude Code CX Codex Cursor +1 113,000installs product-marketing coreyhaines31 Creates and maintains a shared document for product positioning, audience, and brand voice. Use it before other marketing skills so they can refer to the same context. Claude Code CX Codex Cursor +1 83,700installs brag latent-spaces Generates a short, polished launch video from project source code using Hyperframes. Requires no running server or screenshots. Claude Code CX Codex Cursor +1 20,000installs baoyu-post-to-weibo JimLiu Prepares regular Weibo posts and articles through Chrome. Use it when text, media, or a Markdown article needs to be placed in the editor for manual publishing. Claude Code CX Codex Cursor +1 21,600installs investor-outreach affaan-m Drafts cold emails, warm intro blurbs, follow-ups, and investor updates. Use it when fundraising outreach needs a concise message tailored to a specific investor. Claude Code CX Codex Cursor +1 4,400installs

Questions about ads-test

How do I install ads-test in Claude Code?

Run npx skills add AgriciDaniel/claude-ads --skill ads-test -a claude-code. The skill lands in ~/.claude/skills/ads-test/SKILL.md.

What does ads-test do?

It runs a paid-ad experiment step by step: hypothesis, randomization unit, guardrails, sample-size and duration maths, pre-launch checks, then a readout with effect and uncertainty. Output is versioned JSON plus a decision in plain language.

What does it check during a readout?

Assignment integrity and data completeness come before any effect estimate. If the test is underpowered, the result is called noise instead of a winner.

Source text

SKILL.md · MIT 
---
name: ads-test
description: "Design and evaluate paid-ad experiments with hypotheses, randomization units, sample-size and duration assumptions, guardrails, platform experiment tools, analysis, and decision rules. Use for A/B test, split test, experiment design, hypothesis, statistical significance, sample size, test duration, or experiment readout."
---

# Paid Media Experiment

1. State the decision, causal hypothesis, treatment, control, randomization unit,
   population, primary metric, guardrails, minimum effect, and stopping rule.
2. Check platform constraints, overlapping experiments, conversion lag, seasonality,
   interference, and measurement quality.
3. Calculate sample and duration from declared assumptions; disclose approximations.
4. Change one decision surface unless the design explicitly estimates interactions.
5. Pre-register exclusions, quality checks, analysis, and decision thresholds.
6. For readout, verify assignment integrity and data completeness before estimating
   effect and uncertainty.
7. Return setup or readout in versioned JSON with a plain-language decision.

Do not repeatedly peek and stop on a favorable result, call underpowered noise a
winner, or generalize beyond the tested population.

© AgriciDaniel · MIT · AgriciDaniel/claude-ads

See also

Project sponsors

Companies that keep this analytics open
Gold sponsor
Nutra.Club

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor