# acrawl

Automates browser tasks, inspects network calls, checks console logs, and crawls complex sites. Useful when an agent needs full DevTools visibility.

- MCP server · `type=mcp` · Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed · ★ 15
- Author: Mingye-Lu
- License: MIT · policy=link-only · description only; the file stays with the author
- Source: https://github.com/Mingye-Lu/AgenticCrawler
- Updated: 2026-10-17
- HTML: https://affpapa.org/en/nevibecode/mcp/acrawl

## What it does

Built as a standalone Rust binary, the server connects via `acrawl mcp`. It exposes 38 tools plus a goal-driven sub-agent to the model. Rather than just clicking elements, it surfaces DevTools capabilities: request timing inspection, WebSocket logging, TTFB metrics, and axe-core accessibility checks.

The engine serves static pages over HTTP for speed. When detecting frontend markers from React, Vue, or Next.js, it switches to a headless browser automatically. You can also run deterministic JSON routines locally, executing loops and branches without wasting model tokens.

Browser automation relies on a local Chromium download: without it, the agent falls back to pure HTTP fetching. Multi-tab crawling runs parallel sub-agents with a shared URL registry to prevent duplicate visits.

## Requirements
- Needs: a prebuilt binary from the repository releases

## Install

### Claude Code (native platform)

**Install**
- The MCP registry has no launch command for it: see the repository README

## When to use it
- inspect HTTP requests, timings, and console errors
- extract content from pages built with client-side frameworks
- run automated axe-core accessibility audits
- execute deterministic navigation loops without spending LLM tokens

## Example prompts
- Run `run_goal` in acrawl to locate pricing details across the product catalog
- Use `acrawl mcp` to measure TTFB and capture console warnings for the landing page
- Audit page accessibility with axe-core and list WCAG issues

## Similar
- [browser-trace](https://affpapa.org/en/nevibecode/skills/browser-trace.md) — skill · 3000 installs
- [chrome-devtools](https://affpapa.org/en/nevibecode/skills/chrome-devtools.md) — skill · 15258 installs
- [chrome-devtools-cli](https://affpapa.org/en/nevibecode/skills/chrome-devtools-cli.md) — skill · 6800 installs
- [chrome-cdp](https://affpapa.org/en/nevibecode/skills/chrome-cdp.md) — skill · 2100 installs
- [Firefox DevTools MCP](https://affpapa.org/en/nevibecode/mcp/firefox-devtools-mcp.md) — MCP server · ★ 523
- [chrome-devtools-axi](https://affpapa.org/en/nevibecode/skills/chrome-devtools-axi.md) — skill · 6900 installs

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md