# scrapeunblocker-mcp

Connects Claude Code to scraping tools that bypass Cloudflare and DataDome. It fetches fully rendered HTML, extracts clean Markdown, or returns structured JSON.

- MCP server · `type=mcp` · Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed, Gemini CLI · ★ 1
- Author: ScrapeUnblocker
- License: MIT · policy=link-only · description only; the file stays with the author
- Source: https://github.com/ScrapeUnblocker/scrapeunblocker-mcp
- Updated: 2026-10-23
- HTML: https://affpapa.org/en/nevibecode/mcp/scrapeunblocker-mcp

## What it does

The server routes requests through ScrapeUnblocker to get past anti-bot screens like DataDome, Cloudflare, or Akamai. Its `fetch_html` tool grabs complete rendered pages, while `fetch_markdown` strips scripts and navigation. That leaves main content with absolute links at roughly 2-25% of the original HTML footprint. Context stays compact.

When sites require interaction, `browse_page` runs browser steps like clicking tabs, entering text, or scrolling to load content. These actions alter page state directly on the target site, so the tool is not read-only. If any step fails, the server reports the failure point along with the DOM state at that instant.

Over 100 specialized site plugins pull structured data directly from platforms such as Amazon, YouTube, or Booking.com. Without a valid key set in `SCRAPEUNBLOCKER_KEY`, all web fetching fails. Each execution counts as an API request against your account balance.

## Requirements
- Needs: Node.js (commands run via npx)
- Environment variables: `SCRAPEUNBLOCKER_KEY` — keys and tokens: ask the human for the values, never commit them or put them in shared files.

## Install

### Claude Code (native platform)

**Platform CLI**
```bash
claude mcp add scrapeunblocker-mcp -e SCRAPEUNBLOCKER_KEY=<SCRAPEUNBLOCKER_KEY> -- npx -y scrapeunblocker-mcp
```
Replace <…> with your own values

### Codex

**Platform CLI**
```bash
codex mcp add scrapeunblocker-mcp --env SCRAPEUNBLOCKER_KEY=<SCRAPEUNBLOCKER_KEY> -- npx -y scrapeunblocker-mcp
```
Replace <…> with your own values

### Cursor

**Config file**
File `.cursor/mcp.json`:
```json
{
    "mcpServers": {
        "scrapeunblocker-mcp": {
            "command": "npx",
            "args": [
                "-y",
                "scrapeunblocker-mcp"
            ],
            "env": {
                "SCRAPEUNBLOCKER_KEY": "<SCRAPEUNBLOCKER_KEY>"
            }
        }
    }
}
```
Replace <…> with your own values

### GitHub Copilot

**Config file**
File `.vscode/mcp.json`:
```json
{
    "servers": {
        "scrapeunblocker-mcp": {
            "type": "stdio",
            "command": "npx",
            "args": [
                "-y",
                "scrapeunblocker-mcp"
            ],
            "env": {
                "SCRAPEUNBLOCKER_KEY": "<SCRAPEUNBLOCKER_KEY>"
            }
        }
    }
}
```
Replace <…> with your own values

### Gemini CLI

**Platform CLI**
```bash
gemini mcp add -e SCRAPEUNBLOCKER_KEY=<SCRAPEUNBLOCKER_KEY> scrapeunblocker-mcp npx -y scrapeunblocker-mcp
```
Replace <…> with your own values

## When to use it
- extract page content as stripped Markdown to preserve model context
- bypass DataDome and Cloudflare bot barriers on target websites
- click buttons and fill input fields before capturing rendered HTML
- retrieve structured JSON from marketplaces and search engines

## Example prompts
- Use `fetch_markdown` to read the article at <url> and summarize its findings.
- Run `list_elements` on <url>, then use `browse_page` to click the search button and grab the HTML.
- Search Google for running shoes with `google_search` and display the organic results.

## Similar
- [Scrapling MCP Server](https://affpapa.org/en/nevibecode/mcp/scrapling-mcp-server.md) — MCP server · ★ 89899
- [browser-use](https://affpapa.org/en/nevibecode/mcp/browser-use.md) — MCP server · ★ 119231
- [AIHawk](https://affpapa.org/en/nevibecode/mcp/aihawk.md) — MCP server · ★ 32260
- [Skyvern](https://affpapa.org/en/nevibecode/mcp/skyvern.md) — MCP server · ★ 23283
- [SeleniumBase MCP](https://affpapa.org/en/nevibecode/mcp/seleniumbase-mcp.md) — MCP server · ★ 13181
- [apify-mcp-server](https://affpapa.org/en/nevibecode/mcp/apify-mcp-server.md) — MCP server · ★ 13345

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md