skill

scrape · davila7 — Claude Code skill: what it does, how to install

Q: How to install scrape in Claude Code?

Run `npx claude-code-templates@latest --skill web-data/scrape` in your terminal.

Q: What does scrape do?

It executes `scripts/scrape.sh` to retrieve target web pages through the Bright Data Web Unlocker and convert their contents into Markdown.

Q: What prerequisites are required for scrape?

You need `curl` installed and two environment variables configured: `BRIGHTDATA_API_KEY` and `BRIGHTDATA_UNLOCKER_ZONE`.

Pulls web page content as Markdown using the Bright Data Web Unlocker API. It navigates anti-bot measures and CAPTCHAs during extraction.

Install into Claude Code · claude-code-templates All methods and platforms ↓

npx claude-code-templates@latest --skill web-data/scrape

Open on GitHub

What scrape does

The skill triggers scripts/scrape.sh, which uses curl to send extraction requests to the Web Unlocker endpoint. It processes pages that require JavaScript rendering, bypasses challenges, and outputs formatted text with headings and paragraphs.

Requests will fail immediately without BRIGHTDATA_API_KEY and BRIGHTDATA_UNLOCKER_ZONE exported in your environment. Both parameters originate from the Bright Data dashboard at brightdata.com/cp. Outside of these variables and curl, no additional utilities are needed.

What it helps with

extract web article text as formatted Markdown
bypass automated bot verification and CAPTCHA obstacles
retrieve content from pages that depend on client JavaScript
pull product details from a store URL

Example prompts for the agent

Extract the article at https://example.com/article into Markdown
Run scrape on https://shop.example.com/product/123 to fetch product details

How to install scrape

1claude-code-templates

npx claude-code-templates@latest --skill web-data/scrape

2Skills CLI (Vercel)

npx skills add davila7/claude-code-templates --skill scrape -a claude-code

3Manually: put the files in place

~/.claude/skills/scrape/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/scrape/

Manually: put the files in place

.agents/skills/scrape/SKILL.md

For all projects use ~/.agents/skills/

Manually: put the files in place

.cursor/skills/scrape/SKILL.md

Cursor also reads .agents/skills/ and .claude/skills/

1GitHub CLI

gh skill install davila7/claude-code-templates scrape

2Manually: put the files in place

.github/skills/scrape/SKILL.md

Platform CLI

gemini skills install https://github.com/davila7/claude-code-templates --path cli-tool/components/skills/web-data/scrape

Manually: put the files in place

.devin/skills/scrape/SKILL.md

The legacy .windsurf/skills/ path still works

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about scrape

How to install scrape in Claude Code?

Run npx claude-code-templates@latest --skill web-data/scrape in your terminal.

What does scrape do?

It executes scripts/scrape.sh to retrieve target web pages through the Bright Data Web Unlocker and convert their contents into Markdown.

What prerequisites are required for scrape?

You need curl installed and two environment variables configured: BRIGHTDATA_API_KEY and BRIGHTDATA_UNLOCKER_ZONE.

Similar skills

All skills for Browser and scraping →

scrape by other authors comes first.

scrape brightdata Fetch web pages as Markdown, HTML, JSON, or screenshots with bdata scrape. Use it for single pages, URL lists, and paginated listings. CX Codex +1 10,800installs agent-browser vercel-labs A CLI skill for browser control: it opens pages, fills forms, clicks buttons, and tests web apps. Use it when an agent needs to act inside a website. CX Codex +1 1,200,000installs webapp-testing official anthropics This skill tests local web apps with Playwright, helping agents debug UI behavior, capture screenshots, and inspect browser logs. 186,758installs computer-use stablyai This skill drives a visible app window through orca computer: accessibility tree, clicks, typing, screenshots. Reach for it when the job sits behind a GUI. CX Codex +1 239,600installs browser-use browser-use Hands the agent a real Chrome over CDP: clicks, typing, screenshots, and pages that need JS or your logged-in session. CX Codex +1 98,200installs playwright-cli microsoft A skill that hands your agent a browser: open a page, click elements, grab a snapshot, and work with Playwright tests. CX Codex +1 195,700installs last30days mvanhorn Pulls posts and engagement on any topic from the last 30 days across Reddit, X, YouTube, TikTok, Hacker News, Polymarket, GitHub and the web. Useful when you want what people actually said, not what a blog summarized. CX Codex +1 53,000installs

From the same set495

The whole set →

screenshot-ui-analyzer A subagent that turns a UI screenshot into a component list, layout map and design patterns. Handy when you have an image but no mockup or source. 1,018installs c-sharp-pro A dedicated subagent for C# 12 and 13, ASP.NET Core, and EF Core. It writes modern .NET code, structures Clean Architecture, and prepares integration test suites. 1,016installs 3d-artist A Claude Code subagent for game-ready 3D assets, materials, animation, and technical art workflows in Unity and Unreal Engine. 1,011installs agent-overview Multi-agent architecture mapping nine specialized research roles in Claude Code. Coordinates literature reviews, GitHub analysis, and data synthesis. 1,011installs ai-agents-architect Patterns for building autonomous agents: ReAct loops, planning, tool registries and memory. Useful when your agent loops or mishandles tool calls. 995installs database-design This skill guides Claude Code through database and ORM selection, schema design, and query tuning. It stops the model from blindly picking PostgreSQL for every project. 994installs image-enhancer A skill that sharpens images and screenshots, raises their resolution and clears compression artifacts. Handy before publishing a post or a report. 989installs load-testing-specialist Designs load testing scenarios, spots system bottlenecks under stress, and finds service breaking points before production release. 986installs