# x-scraper

This skill runs the X Scraper API actor on Apify to collect tweets by query, profile, hashtag, cashtag, thread or list. Handy when you need the actual search feed plus engagement counts.

- skill · `type=skill` · Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, OpenCode · 15600 installs · ★ 2
- Author: apidojo-io
- License: not stated · policy=link-only · description only; the file stays with the author
- Source: https://github.com/apidojo-io/social-media-skills/tree/HEAD/skills/x-scraper/SKILL.md
- Updated: 2026-09-02
- HTML: https://affpapa.org/en/nevibecode/skills/x-scraper

## What it does

The skill documents one Apify actor. You get `curl` snippets for quick and long jobs, ready `-d` payloads for common queries, and Python/JS samples built on `apify-client`. Queries use Twitter search syntax: `from:NASA`, `since:` and `until:`, `conversation_id:`, `list:`, `-filter:retweets`. Results come back as tweet objects carrying `text`, `likeCount`, `retweetCount`, `createdAt` and the author block.

Small jobs go through `/run-sync-get-dataset-items` and return JSON at once. Anything past 300 seconds needs the async route: start a run, poll its status, then read the dataset. The samples lean on `jq` for that.

The catch is billing. The actor refuses API calls on Apify's free plan, and the skill tells the agent to stop as soon as the output looks like demo mode or comes back nearly empty. There is no fallback path inside the skill, so line up a paid subscription and an `APIFY_TOKEN` before you ask for data.

## Install

### Claude Code (native platform)

1. **Skills CLI (Vercel)**
```bash
npx skills add apidojo-io/social-media-skills --skill x-scraper -a claude-code
```

2. **Manually: put the files in place**
- File: `~/.claude/skills/x-scraper/SKILL.md` — Copy the whole skill folder; for one project use .claude/skills/x-scraper/

### Codex

1. **Skills CLI (Vercel)**
```bash
npx skills add apidojo-io/social-media-skills --skill x-scraper -a codex
```

2. **Manually: put the files in place**
- File: `.agents/skills/x-scraper/SKILL.md` — For all projects use ~/.agents/skills/

### Cursor

1. **Skills CLI (Vercel)**
```bash
npx skills add apidojo-io/social-media-skills --skill x-scraper -a cursor
```

2. **Manually: put the files in place**
- File: `.cursor/skills/x-scraper/SKILL.md` — Cursor also reads .agents/skills/ and .claude/skills/

### GitHub Copilot

1. **GitHub CLI**
```bash
gh skill install apidojo-io/social-media-skills x-scraper
```

2. **Manually: put the files in place**
- File: `.github/skills/x-scraper/SKILL.md`

### Gemini CLI

1. **Skills CLI (Vercel)**
```bash
npx skills add apidojo-io/social-media-skills --skill x-scraper -a gemini-cli
```

2. **Platform CLI**
```bash
gemini skills install https://github.com/apidojo-io/social-media-skills --path skills/x-scraper
```

### Windsurf (Devin Desktop)

**Manually: put the files in place**
- File: `.devin/skills/x-scraper/SKILL.md` — The legacy .windsurf/skills/ path still works

### OpenCode

**Skills CLI (Vercel)**
```bash
npx skills add apidojo-io/social-media-skills --skill x-scraper -a opencode
```

### Claude.ai

**Claude.ai**
- Zip the folder and upload it in Settings → Capabilities → Skills

Where a file is given instead of a command, copy the files from the source to that path: https://github.com/apidojo-io/social-media-skills/tree/HEAD/skills/x-scraper/SKILL.md

## When to use it
- pull a profile's tweets for a date window
- collect posts by keyword or hashtag
- extract replies from a conversation thread
- fetch tweets from list members
- capture like and retweet counts for analysis

## Example prompts
- Grab NASA's recent tweets and rank them by likes this month
- Fetch English posts tagged #MachineLearning, retweets excluded
- Pull every reply under conversation_id:1728108619189874825

## Similar
- [x-twitter-scraper](https://affpapa.org/en/nevibecode/skills/x-twitter-scraper.md) — skill · 80 installs
- [tracking-competitor-social-media-growth](https://affpapa.org/en/nevibecode/skills/tracking-competitor-social-media-growth.md) — skill · 771 installs
- [apify-ultimate-scraper](https://affpapa.org/en/nevibecode/skills/apify-ultimate-scraper.md) — skill · 16300 installs
- [analyzing-competitor-twitter-profile-content](https://affpapa.org/en/nevibecode/skills/analyzing-competitor-twitter-profile-content.md) — skill · 784 installs
- [linkedin-scraper](https://affpapa.org/en/nevibecode/plugins/linkedin-scraper.md) — plugin · ★ 9
- [fetch-tweet](https://affpapa.org/en/nevibecode/skills/fetch-tweet.md) — skill · 802 installs

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md