# Open SEO Crawler

Crawls a site for technical SEO issues and checks what search and AI bots can access. An MCP client can start crawls and retrieve page data.

- MCP server · `type=mcp` · Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed · ★ 72
- Author: puneetindersingh
- License: MIT · policy=link-only · description only; the file stays with the author
- Source: https://github.com/puneetindersingh/open-seo-crawler
- Updated: 2026-10-23
- HTML: https://affpapa.org/en/nevibecode/mcp/open-seo-crawler

## What it does

Open SEO Crawler crawls websites and checks for technical SEO issues. Its bot check reports what Googlebot, Bingbot, Applebot and AI crawlers receive, including blocked pages and text that appears only after JavaScript runs.

The MCP server lets an assistant start a crawl, read its summary, filter pages by issue and inspect a page with its inlinks. It can also compare two crawls, check a URL for AI crawler access and export data to `.xlsx`. The project includes the `osc.py` command-line tool, which uses Python’s standard library. The crawler itself does not call AI services; your assistant sends requests to it.

The crawler runs locally, so the audit stays on your machine. Bot checks depend on what the server serves: content that appears only after JavaScript executes is flagged separately.

## Requirements
- Needs: Python and uv (commands run via uvx)

## Install

### Claude Code (native platform)

**Install**
- The MCP registry has no launch command for it: see the repository README

## When to use it
- find technical SEO issues across a site
- check what search and AI crawlers can access
- filter pages by issue
- inspect a page and its inlinks
- compare results from two crawls

## Example prompts
- Run a site crawl and show me the issue summary.
- Check what AI crawlers can access on this URL.
- Compare two crawls and list pages with issues.

## Similar
- [New-Term Radar](https://affpapa.org/en/nevibecode/mcp/new-term-radar.md) — MCP server · ★ 1766
- [NotFair](https://affpapa.org/en/nevibecode/mcp/notfair.md) — MCP server · ★ 4055
- [seo-monster](https://affpapa.org/en/nevibecode/mcp/seo-monster.md) — MCP server · ★ 553
- [Google Maps MCP Server](https://affpapa.org/en/nevibecode/mcp/google-maps-mcp-server.md) — MCP server · ★ 479
- [Search Console MCP](https://affpapa.org/en/nevibecode/mcp/search-console-mcp.md) — MCP server · ★ 308
- [squirrelscan](https://affpapa.org/en/nevibecode/mcp/squirrelscan.md) — MCP server · ★ 296

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md