# webclaw

The webclaw MCP server for Claude Code searches the web, crawls pages and extracts structured information. It feeds website content to an AI agent for research tasks.

- MCP server · `type=mcp` · Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed, Gemini CLI · ★ 2442 repo stars
- Author: 0xMassi
- License: AGPL-3.0 · policy=link-only · description only; the file stays with the author
- Source: https://github.com/0xMassi/webclaw
- Updated: 2026-11-16
- Security check: automated, 2026-11-17 (text) — no signs of malicious code found.
- HTML: https://affpapa.org/en/nevibecode/mcp/webclaw

## What it does

webclaw gives an agent tools to search the web, crawl pages and extract structured information. The results provide website content for the agent to work with.

Claude Code can connect to the hosted server over HTTP or start a local server with `npx`. The local option needs the `@webclaw/mcp` package and a `WEBCLAW_API_KEY`; the hosted connection command does not set a key.

## Requirements
- Needs: Node.js (commands run via npx)
- Remote server: `https://api.webclaw.io/mcp`
- Environment variables: `WEBCLAW_API_KEY` — keys and tokens: ask the human for the values, never commit them or put them in shared files.

## Install

### Claude Code (native platform)

1. **Platform CLI: remote server**
```bash
claude mcp add --transport http webclaw https://api.webclaw.io/mcp
```

2. **Platform CLI**
```bash
claude mcp add --env WEBCLAW_API_KEY=<WEBCLAW_API_KEY> --transport stdio webclaw -- npx -y @webclaw/mcp
```
Replace <…> with your own values

### Codex

1. **Platform CLI: remote server**
```bash
codex mcp add webclaw --url https://api.webclaw.io/mcp
```

2. **Platform CLI**
```bash
codex mcp add webclaw --env WEBCLAW_API_KEY=<WEBCLAW_API_KEY> -- npx -y @webclaw/mcp
```
Replace <…> with your own values

### Cursor

**Config file**
File `.cursor/mcp.json`:
```json
{
    "mcpServers": {
        "webclaw": {
            "url": "https://api.webclaw.io/mcp"
        }
    }
}
```
File `.cursor/mcp.json`:
```json
{
    "mcpServers": {
        "webclaw": {
            "command": "npx",
            "args": [
                "-y",
                "@webclaw/mcp"
            ],
            "env": {
                "WEBCLAW_API_KEY": "<WEBCLAW_API_KEY>"
            }
        }
    }
}
```
Replace <…> with your own values

### GitHub Copilot

**Config file**
File `.vscode/mcp.json`:
```json
{
    "servers": {
        "webclaw": {
            "type": "http",
            "url": "https://api.webclaw.io/mcp"
        }
    }
}
```
File `.vscode/mcp.json`:
```json
{
    "servers": {
        "webclaw": {
            "type": "stdio",
            "command": "npx",
            "args": [
                "-y",
                "@webclaw/mcp"
            ],
            "env": {
                "WEBCLAW_API_KEY": "<WEBCLAW_API_KEY>"
            }
        }
    }
}
```
Replace <…> with your own values

### Gemini CLI

1. **Platform CLI: remote server**
```bash
gemini mcp add -t http webclaw https://api.webclaw.io/mcp
```

2. **Platform CLI**
```bash
gemini mcp add -e WEBCLAW_API_KEY=<WEBCLAW_API_KEY> webclaw npx -y @webclaw/mcp
```
Replace <…> with your own values

## When to use it
- search web pages for information
- collect data across a site's pages
- extract structured information from websites
- supply website content to an AI agent

## Example prompts
- Find information about this topic online and gather the main facts.
- Crawl this site and extract structured information from its pages.
- Research these web pages and prepare their content for further work.

## Similar
- [firecrawl-alexandria](https://affpapa.org/en/nevibecode/skills/firecrawl-alexandria.md) — skill · 2900 installs
- [Geonode MCP Server](https://affpapa.org/en/nevibecode/mcp/geonode-mcp-server.md) — MCP server · ★ 27 repo stars
- [Crawlora MCP](https://affpapa.org/en/nevibecode/mcp/crawlora-mcp.md) — MCP server · ★ 1 repo stars
- [срезAI — MCP-сервер и поисковый API для ИИ-агентов](https://affpapa.org/en/nevibecode/mcp/srezai-mcp-server-i-poiskovyi-api-dlia-ii-agentov.md) — MCP server
- [firecrawl](https://affpapa.org/en/nevibecode/skills/firecrawl.md) — skill · 104500 installs
- [venice-augment](https://affpapa.org/en/nevibecode/skills/venice-augment.md) — skill · ★ 176 repo stars

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md
