firecrawl-crawl — Claude Code skill: bulk page scraping
Skill to automatically extract multiple pages from a website or section by following links. Use it to gather documentation, site content, or data across linked pages.
npx skills add firecrawl/cli --skill firecrawl-crawl -a claude-codeWhat firecrawl-crawl does
firecrawl-crawl downloads content from multiple pages at once, traversing links while respecting section boundaries. The firecrawl crawl command takes a URL and options like --include-paths /docs to limit scope, --max-depth 3 for traversal depth, and --limit 50 for page count. Results save to JSON.
By default the command returns a job ID and runs in the background; use --wait to block until crawling finishes. Without it, poll status with firecrawl crawl <job-id>. To prevent hanging, pair --wait with --timeout <seconds>.
Authentication is required — firecrawl will prompt for login on first use. Each page crawled consumes credits; check your balance with firecrawl credit-usage before large runs.
What it helps with
- extract documentation from all pages in a section
- download content spanning multiple linked pages
- limit scraping to a specific site area
- check if a background crawl finished
Example prompts for the agent
- Scrape all pages under /docs with a limit of 50, save to .firecrawl/crawl.json
- Run a full site crawl to depth 3 and wait for completion
- Check status of a crawl using its job ID
How to install firecrawl-crawl
1Skills CLI (Vercel)
npx skills add firecrawl/cli --skill firecrawl-crawl -a claude-code2Manually: put the files in place
~/.claude/skills/firecrawl-crawl/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/firecrawl-crawl/
1Skills CLI (Vercel)
npx skills add firecrawl/cli --skill firecrawl-crawl -a codex2Manually: put the files in place
.agents/skills/firecrawl-crawl/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add firecrawl/cli --skill firecrawl-crawl -a cursor2Manually: put the files in place
.cursor/skills/firecrawl-crawl/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install firecrawl/cli firecrawl-crawl2Manually: put the files in place
.github/skills/firecrawl-crawl/SKILL.md1Skills CLI (Vercel)
npx skills add firecrawl/cli --skill firecrawl-crawl -a gemini-cli2Platform CLI
gemini skills install https://github.com/firecrawl/cli --path skills/firecrawl-crawlManually: put the files in place
.devin/skills/firecrawl-crawl/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add firecrawl/cli --skill firecrawl-crawl -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
From the same set4
The whole set →Similar
Questions about firecrawl-crawl
How do I install firecrawl-crawl in Claude Code?
Run npx skills add firecrawl/cli --skill firecrawl-crawl -a claude-code. The skill installs to ~/.claude/skills/firecrawl-crawl/.
What does firecrawl-crawl do?
It extracts content from multiple pages on a website or section by following links up to a specified depth or page limit. Useful for collecting documentation, site content, and data across connected pages.
Do I need an API key?
Yes, firecrawl authentication is required. There is no free tier without credentials; the CLI will prompt for interactive login on first run. Each page crawled consumes credits.
