Atlas Web Compiler & Scraper — Claude Code MCP server: what it does
An MCP server that turns web pages into clean markdown, maps site structure and compiles pages in batches without an LLM in the loop.
claude mcp add --transport http atlas https://api.atlas-compiler.com/mcpWhat Atlas Web Compiler & Scraper does
Atlas Web Compiler & Scraper wires your coding agent into the Atlas pipeline, which parses pages into structured markdown. The compiler engine does the parsing, so nothing gets summarised away and no invented text shows up in the output. Long pages are handled too: the server builds a table of contents, splits content into sections, watches the token budget and marks anything it had to cut.
Two transports are available. Run the stdio bridge locally with npx -y @atlascompiler/mcp, or point remote clients at the HTTP endpoint on POST /mcp. The setup wizard npx -y @atlascompiler/mcp init validates your key and merges the server block into editor configs without writing the token into project files. Credentials live in ~/.atlas/credentials.json with 0600 permissions; in CI you pass ATLAS_API_KEY instead.
The CLI refuses --api-key and -k flags and exits with code 1, so the key never lands in ps aux output. Outbound requests go through atlas-egress, and atlas:// resources stay scoped to a single workspace. You need an atlas_... key from the Atlas dashboard before any of this works.
What it helps with
- pull article text into markdown without a model rewriting it
- map a site's sections before crawling
- compile a batch of pages in one run
- trim a long page to a token budget with a visible cut marker
- configure an MCP server in your editor without committing the key
Example prompts for the agent
- Compile https://atlas-compiler.com into markdown and show me the table of contents
- Map this site and crawl the documentation section
- Gather these pages into one file, trimming to the token budget
How to install Atlas Web Compiler & Scraper
1Platform CLI: remote server
claude mcp add --transport http atlas https://api.atlas-compiler.com/mcp2Platform CLI
claude mcp add --env ATLAS_API_KEY=<ATLAS_API_KEY> --transport stdio mcp -- npx -y @atlascompiler/mcpReplace <…> with your own values
1Platform CLI: remote server
codex mcp add mcp --url https://api.atlas-compiler.com/mcp2Platform CLI
codex mcp add mcp --env ATLAS_API_KEY=<ATLAS_API_KEY> -- npx -y @atlascompiler/mcpReplace <…> with your own values
Config file
{
"mcpServers": {
"mcp": {
"url": "https://api.atlas-compiler.com/mcp"
}
}
}{
"mcpServers": {
"mcp": {
"command": "npx",
"args": [
"-y",
"@atlascompiler/mcp"
],
"env": {
"ATLAS_API_KEY": "<ATLAS_API_KEY>"
}
}
}
}Replace <…> with your own values
Config file
{
"servers": {
"mcp": {
"type": "http",
"url": "https://api.atlas-compiler.com/mcp"
}
}
}{
"servers": {
"mcp": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"@atlascompiler/mcp"
],
"env": {
"ATLAS_API_KEY": "<ATLAS_API_KEY>"
}
}
}
}Replace <…> with your own values
1Platform CLI: remote server
gemini mcp add -t http mcp https://api.atlas-compiler.com/mcp2Platform CLI
gemini mcp add -e ATLAS_API_KEY=<ATLAS_API_KEY> mcp npx -y @atlascompiler/mcpReplace <…> with your own values
Step by step, with commands for each platform: How to add an MCP server to Claude Code, Codex, Cursor, VS Code, Gemini CLI and more
Questions about Atlas Web Compiler & Scraper
How do I install Atlas Web Compiler & Scraper in Claude Code?
Run claude mcp add --transport http atlas https://api.atlas-compiler.com/mcp. For a local stdio setup use claude mcp add --env ATLAS_API_KEY=<ATLAS_API_KEY> --transport stdio mcp -- npx -y @atlascompiler/mcp.
What does Atlas Web Compiler & Scraper do?
It converts web pages into clean markdown, discovers site topology, crawls within bounds and compiles pages in batches. Parsing happens in the Atlas engine rather than through model generation.
What do I need before running it?
An atlas_... API key from the Atlas dashboard. The init wizard stores it, or you supply ATLAS_API_KEY; the CLI blocks --api-key and -k flags.
