ScrapingBot — Claude Code MCP server: features and setup
Gives an agent tools to fetch web pages and query public data from Google, TikTok, Instagram, and Amazon. An API key is required.
claude mcp add --transport http scrapingbot https://scrapingbot.io/api/mcpWhat ScrapingBot does
ScrapingBot exposes tools for retrieving web pages as HTML or Markdown, including pages that need JavaScript rendering. An agent can request selected fields as JSON or run browser actions such as clicking, typing, scrolling, and waiting. Separate tools cover public data from Google, TikTok, Instagram, and Amazon.
The hosted service connects over Streamable HTTP, so there is no local server to install. Add it to Claude Code with claude mcp add --transport http scrapingbot https://scrapingbot.io/api/mcp, then provide a ScrapingBot API key in the x-api-key header. Requests cannot be authorized without that key. Tool calls use credits according to the API behind each tool.
What it helps with
- fetch a web page as HTML or Markdown
- extract selected page fields into JSON
- search Google for public results
- retrieve public TikTok or Instagram profile data
- run browser actions such as clicking and scrolling
Example prompts for the agent
- Fetch
https://example.comand return the page as Markdown. - Extract the product name and price from this page as JSON.
- Search Google for reviews of this place and summarize the results.
How to install ScrapingBot
Platform CLI: remote server
claude mcp add --transport http scrapingbot https://scrapingbot.io/api/mcpPlatform CLI: remote server
codex mcp add scrapingbot --url https://scrapingbot.io/api/mcpConfig file
{
"mcpServers": {
"scrapingbot": {
"url": "https://scrapingbot.io/api/mcp"
}
}
}Config file
{
"servers": {
"scrapingbot": {
"type": "http",
"url": "https://scrapingbot.io/api/mcp"
}
}
}Platform CLI: remote server
gemini mcp add -t http scrapingbot https://scrapingbot.io/api/mcpStep by step, with commands for each platform: How to add an MCP server to Claude Code, Codex, Cursor, VS Code, Gemini CLI and more
Questions about ScrapingBot
How do I install ScrapingBot in Claude Code?
Run claude mcp add --transport http scrapingbot https://scrapingbot.io/api/mcp. Configure a ScrapingBot API key in the x-api-key header for authenticated requests.
What does ScrapingBot do?
It gives agents tools to retrieve web pages, extract structured fields, and query public data from Google, TikTok, Instagram, and Amazon.
Does ScrapingBot require an API key?
Yes. Requests must be authenticated with a ScrapingBot key, for example through the x-api-key header.
