# agentbuilt

Checks how readable and reachable a URL is for AI crawlers. Useful for reviewing robots rules, JavaScript-free content, JSON-LD and llms.txt.

- MCP server · `type=mcp` · Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed, Gemini CLI
- Author: agentbuilt
- License: MIT · policy=link-only · description only; the file stays with the author
- Source: https://github.com/agentbuilt/agentbuilt-mcp
- Updated: 2026-09-23
- HTML: https://affpapa.org/en/nevibecode/mcp/agentbuilt

## What it does

agentbuilt is a stateless MCP server for inspecting a website’s AI readiness. Its `audit_ai_readiness` tool fetches a URL and reviews crawler rules for GPTBot, ClaudeBot, PerplexityBot and Google-Extended, along with visible text without JavaScript, JSON-LD, `llms.txt`, a sitemap, canonical data, a meta description and FAQ schema. The result includes a score, findings and suggested fixes.

Two other tools are exposed: `list_agentbuilt_tools` shows agentbuilt’s paid data services, while `request_visibility_audit` starts a paid check of whether ChatGPT or Perplexity recommends a brand. That request needs consent and email double opt-in. The free tools need no environment variables. In a self-hosted deployment, the paid request returns an error unless `WAITLIST_KEY`, `APIFY_TOKEN` and `WAITLIST_DATASET_ID` are set.

The endpoint can be added to Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed or Gemini CLI. It uses Streamable HTTP and keeps no session state. A2A access is available through the agent endpoint as well.

## Requirements
- Remote server: `https://agentbuilt.dev/api/mcp`

## Install

### Claude Code (native platform)

**Platform CLI: remote server**
```bash
claude mcp add --transport http agentbuilt https://agentbuilt.dev/api/mcp
```

### Codex

**Platform CLI: remote server**
```bash
codex mcp add agentbuilt --url https://agentbuilt.dev/api/mcp
```

### Cursor

**Config file**
File `.cursor/mcp.json`:
```json
{
    "mcpServers": {
        "agentbuilt": {
            "url": "https://agentbuilt.dev/api/mcp"
        }
    }
}
```

### GitHub Copilot

**Config file**
File `.vscode/mcp.json`:
```json
{
    "servers": {
        "agentbuilt": {
            "type": "http",
            "url": "https://agentbuilt.dev/api/mcp"
        }
    }
}
```

### Gemini CLI

**Platform CLI: remote server**
```bash
gemini mcp add -t http agentbuilt https://agentbuilt.dev/api/mcp
```

## When to use it
- audit a URL for AI crawler access
- spot content that exists only after JavaScript runs
- inspect JSON-LD, sitemap and `llms.txt`
- turn readiness findings into concrete fixes
- request a brand recommendation audit for ChatGPT and Perplexity

## Example prompts
- Audit `https://example.com` for AI crawler readability.
- Check `https://example.com` for robots rules, JSON-LD and `llms.txt` issues.
- Use `request_visibility_audit` for this brand and tell me what consent and setup it requires.

## Similar
- [REA](https://affpapa.org/en/nevibecode/mcp/rea.md) — MCP server · ★ 397855
- [GitHub](https://affpapa.org/en/nevibecode/mcp/github.md) — MCP server · ★ 34011
- [World Monitor](https://affpapa.org/en/nevibecode/mcp/world-monitor.md) — MCP server · ★ 89674
- [Netdata](https://affpapa.org/en/nevibecode/mcp/netdata.md) — MCP server · ★ 81191
- [Front-End Checklist](https://affpapa.org/en/nevibecode/mcp/front-end-checklist.md) — MCP server · ★ 74577
- [Scrapling MCP Server](https://affpapa.org/en/nevibecode/mcp/scrapling-mcp-server.md) — MCP server · ★ 90077

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md