Open SEO Crawler — Claude Code MCP server: site audit
Crawls a site for technical SEO issues and checks what search and AI bots can access. An MCP client can start crawls and retrieve page data.
Open on GitHubWhat Open SEO Crawler does
Open SEO Crawler crawls websites and checks for technical SEO issues. Its bot check reports what Googlebot, Bingbot, Applebot and AI crawlers receive, including blocked pages and text that appears only after JavaScript runs.
The MCP server lets an assistant start a crawl, read its summary, filter pages by issue and inspect a page with its inlinks. It can also compare two crawls, check a URL for AI crawler access and export data to .xlsx. The project includes the osc.py command-line tool, which uses Python’s standard library. The crawler itself does not call AI services; your assistant sends requests to it.
The crawler runs locally, so the audit stays on your machine. Bot checks depend on what the server serves: content that appears only after JavaScript executes is flagged separately.
What it helps with
- find technical SEO issues across a site
- check what search and AI crawlers can access
- filter pages by issue
- inspect a page and its inlinks
- compare results from two crawls
Example prompts for the agent
- Run a site crawl and show me the issue summary.
- Check what AI crawlers can access on this URL.
- Compare two crawls and list pages with issues.
How to install Open SEO Crawler
Install
The MCP registry has no launch command for it: see the repository README
Step by step, with commands for each platform: How to add an MCP server to Claude Code, Codex, Cursor, VS Code, Gemini CLI and more
Questions about Open SEO Crawler
How do I install Open SEO Crawler in Claude Code?
Open SEO Crawler connects to Claude Code as an MCP server. The project also includes osc.py for command-line use, and it relies on Python’s standard library.
What does Open SEO Crawler do?
It crawls websites for technical SEO issues and checks what search and AI crawlers receive. An MCP assistant can start crawls and read their results.
Does Open SEO Crawler need an API key?
The crawler runs locally and does not make AI service calls itself. An MCP assistant can send it crawl requests and read the results.
