web-scraping · makushingu — Claude Code skill: what it does, how to install
The web-scraping skill for Claude Code extracts data from websites into Markdown, CSV, or JSON. It triggers when asked to collect or monitor web content.
no license ★ 285 updated 2026-11-17
npx skills add makushingu/harness-maxxing --skill web-scraping -a claude-codeWhat web-scraping does
The skill facilitates data collection from static and JavaScript-rendered pages using three distinct fetchers. Standard pages utilize Fetcher, while DynamicFetcher processes JavaScript content and StealthyFetcher handles sites with browser detection. The environment must have scrapling and scrapling-python packages installed on the server.
Scripts utilize css or xpath selectors to target specific elements. For development, inspect the raw HTML by running scrapling extract get URL page.html to confirm selectors before finalizing scripts. Results should be stored within the data/ directory. When automating, the maxxing-cron skill executes scripts periodically to compare changes against previous results.
What it helps with
- Extract product pricing from an online catalog
- Convert raw article text into formatted Markdown
- Monitor webpage updates for price or content changes
Example prompts for the agent
- Scrape data from example.com and save it to
data/products.json - Extract content using
StealthyFetcherfor the site example.com - Set up a monitor to check for changes on example.com and report them
How to install web-scraping
1Skills CLI (Vercel)
npx skills add makushingu/harness-maxxing --skill web-scraping -a claude-code2Manually: put the files in place
~/.claude/skills/web-scraping/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/web-scraping/
1Skills CLI (Vercel)
npx skills add makushingu/harness-maxxing --skill web-scraping -a codex2Manually: put the files in place
.agents/skills/web-scraping/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add makushingu/harness-maxxing --skill web-scraping -a cursor2Manually: put the files in place
.cursor/skills/web-scraping/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install makushingu/harness-maxxing skills/web-scraping2Manually: put the files in place
.github/skills/web-scraping/SKILL.md1Skills CLI (Vercel)
npx skills add makushingu/harness-maxxing --skill web-scraping -a gemini-cli2Platform CLI
gemini skills install https://github.com/makushingu/harness-maxxing --path skills/web-scrapingManually: put the files in place
.devin/skills/web-scraping/SKILL.mdThe legacy .windsurf/skills/ path still works
Claude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about web-scraping
How to install web-scraping in Claude Code?
Run npx skills add makushingu/harness-maxxing --skill web-scraping -a claude-code in your terminal.
What does web-scraping do?
This skill enables data extraction from websites, file format conversion, and scheduled content monitoring.
What is required for web-scraping?
The scrapling and scrapling-python packages must be installed on the host server.
Similar skills
All skills for Agent setup: memory, context, orchestration →web-scraping by other authors comes first.