# scraper

Pulls readable page text, links, and metadata from URLs. Use it when an AI assistant needs web documentation or article content without manual copying.

- MCP server · `type=mcp` · Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed, Gemini CLI · ★ 6
- Author: ofershap
- License: MIT · policy=link-only · description only; the file stays with the author
- Source: https://github.com/ofershap/mcp-server-scraper
- Updated: 2026-08-10
- HTML: https://affpapa.org/en/nevibecode/mcp/scraper

## What it does

The server fetches a URL and provides separate tools for page text, links, and metadata. It can also find matching lines on a page or process several URLs, returning a title and excerpt for each one.

It parses HTML in Node with Mozilla Readability and linkedom, without launching a headless browser. No API key is needed. Pages with content already present in their HTML are the best fit; client-rendered SPAs are outside its reach, so those require a browser MCP server.

## Requirements
- Needs: Node.js (commands run via npx)

## Install

### Claude Code (native platform)

**Platform CLI**
```bash
claude mcp add scraper -- npx -y mcp-server-scraper
```

### Codex

**Platform CLI**
```bash
codex mcp add scraper -- npx -y mcp-server-scraper
```

### Cursor

**Config file**
File `.cursor/mcp.json`:
```json
{
    "mcpServers": {
        "scraper": {
            "command": "npx",
            "args": [
                "-y",
                "mcp-server-scraper"
            ]
        }
    }
}
```

### GitHub Copilot

**Config file**
File `.vscode/mcp.json`:
```json
{
    "servers": {
        "scraper": {
            "type": "stdio",
            "command": "npx",
            "args": [
                "-y",
                "mcp-server-scraper"
            ]
        }
    }
}
```

### Gemini CLI

**Platform CLI**
```bash
gemini mcp add scraper npx -y mcp-server-scraper
```

## When to use it
- turn a documentation page into Markdown
- collect page links and their anchor text
- retrieve a URL’s title, description, and OG tags
- find matching lines within a web page
- process several URLs and get an excerpt for each

## Example prompts
- Read `https://docs.example.com`, extract its content, and summarize the page.
- Collect every link on this page with its anchor text.
- Search this page for `authentication` and retrieve the URL’s title and description.

## Similar
- [Scrapling MCP Server](https://affpapa.org/en/nevibecode/mcp/scrapling-mcp-server.md) — MCP server · ★ 89899
- [browser-use](https://affpapa.org/en/nevibecode/mcp/browser-use.md) — MCP server · ★ 119231
- [AIHawk](https://affpapa.org/en/nevibecode/mcp/aihawk.md) — MCP server · ★ 32260
- [Skyvern](https://affpapa.org/en/nevibecode/mcp/skyvern.md) — MCP server · ★ 23283
- [SeleniumBase MCP](https://affpapa.org/en/nevibecode/mcp/seleniumbase-mcp.md) — MCP server · ★ 13181
- [apify-mcp-server](https://affpapa.org/en/nevibecode/mcp/apify-mcp-server.md) — MCP server · ★ 13345

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md