agentwebmap — Claude Code MCP server: find docs via llms.txt
A hosted MCP server that looks up publisher documentation through llms.txt and returns original source links with check dates.
claude mcp add --transport http agentwebmap https://agentwebmap.com/mcpWhat agentwebmap does
Agent Web Map indexes sites that publish llms.txt. Through the MCP server an agent searches by publisher or task, gets links to the original pages, and sees how fresh each file is. Public discovery runs without an account or API key.
The server is hosted, so there is nothing to run locally — your client connects straight to https://agentwebmap.com/mcp. The tools cover task-based lookup, related-site suggestions, and country filters such as country=FR or country=unknown. A separate skill at skills/agentwebmap-docs/SKILL.md spells out when discovery is worth trying and when to read the primary source instead. Connecting only exposes the tools; the host decides when to call them.
Provenance is explicit: match strength and stale flags appear in the response. Country evidence may come from an owner declaration, a published address, a domain suffix or hosting, and the response tells those apart — that is not a confirmed headquarters. Related sites are search hints, not a sign of partnership.
What it helps with
- find a publisher's docs for a specific task
- check whether someone's
llms.txtis stale - collect original source links instead of summaries
- filter sites by country or category
- surface publishers that share the same headings
Example prompts for the agent
- Find Cloudflare Workers docs through agentwebmap
- Show sites similar to
cloudflare.comwithsimilar_sites - List publishers with
llms.txtabout payments, countryFR
How to install agentwebmap
Platform CLI: remote server
claude mcp add --transport http agentwebmap https://agentwebmap.com/mcpPlatform CLI: remote server
codex mcp add agentwebmap --url https://agentwebmap.com/mcpConfig file
{
"mcpServers": {
"agentwebmap": {
"url": "https://agentwebmap.com/mcp"
}
}
}Config file
{
"servers": {
"agentwebmap": {
"type": "http",
"url": "https://agentwebmap.com/mcp"
}
}
}Platform CLI: remote server
gemini mcp add -t http agentwebmap https://agentwebmap.com/mcpStep by step, with commands for each platform: How to add an MCP server to Claude Code, Codex, Cursor, VS Code, Gemini CLI and more
Questions about agentwebmap
How do I install agentwebmap in Claude Code?
Run claude mcp add --transport http agentwebmap https://agentwebmap.com/mcp. No local server is involved; the client talks to the hosted endpoint.
What does agentwebmap do?
It finds publisher documentation via llms.txt and returns links to the original sources along with freshness signals. You can use it from the web directory or over MCP.
Does agentwebmap need an API key?
Public discovery does not — no account or key required. Private collections and listing management need an email-code sign-in.