Crawlie — Claude Code MCP server: audits and installation
Crawlie lets an agent run technical SEO and GEO audits, inspect findings, and compare reports. Use it when site checks need to run through MCP.
claude mcp add --transport http crawlie https://crawlie.app/mcpWhat Crawlie does
Crawlie crawls a whole site or selected URLs and checks issues such as broken links, redirects, missing metadata, and AI-search readiness. Its MCP tools let an agent run audits, inspect affected URLs, review top fixes, and compare saved reports. Separate Health, GEO, and Accessibility scores keep one category from masking another.
You can connect the local crawlie-mcp process or use the hosted MCP endpoint at https://crawlie.app/mcp. The Claude Code setup command is claude mcp add --transport http crawlie https://crawlie.app/mcp; the hosted service requires a Crawlie API key. The CLI also supports JSON output, saved report history, and CI failure thresholds.
Crawlie works with Claude Code, Codex, Cursor, GitHub Copilot, Cline, Zed, and other MCP clients. Hosted crawls count against the selected plan, so the API access and available usage need checking before relying on the cloud connection.
What it helps with
- scan a site for broken links and redirects
- spot missing metadata and GEO gaps
- produce a technical SEO report
- compare findings across two reports
- sort fixes by severity
Example prompts for the agent
- Run a full technical SEO and GEO audit for the site, then list the highest-priority fixes.
- Check
https://example.com/pricingfor metadata, link, and AI-search readiness issues. - Compare the latest crawl with the previous report and explain what changed.
How to install Crawlie
Platform CLI: remote server
claude mcp add --transport http crawlie https://crawlie.app/mcpPlatform CLI: remote server
codex mcp add crawlie --url https://crawlie.app/mcpConfig file
{
"mcpServers": {
"crawlie": {
"url": "https://crawlie.app/mcp"
}
}
}Config file
{
"servers": {
"crawlie": {
"type": "http",
"url": "https://crawlie.app/mcp"
}
}
}Platform CLI: remote server
gemini mcp add -t http crawlie https://crawlie.app/mcpStep by step, with commands for each platform: How to add an MCP server to Claude Code, Codex, Cursor, VS Code, Gemini CLI and more
Questions about Crawlie
How do I install Crawlie in Claude Code?
Run claude mcp add --transport http crawlie https://crawlie.app/mcp, then provide a Crawlie API key for the hosted server.
What does Crawlie do?
Crawlie audits sites for technical SEO and GEO issues, including broken links, redirects, and missing metadata. An agent can inspect findings and review suggested fixes through MCP.
What is required for Crawlie Cloud MCP?
You need a Crawlie API key created in the dashboard. Hosted crawls run on Crawlie infrastructure and are counted against your plan.
