Skip to main content
skill Claude Code CX Codex Cursor GitHub Copilot

firecrawl-build-scrape — Claude Code skill: setup and features

This skill guides integration of Firecrawl /scrape into product code for single-page extraction. It applies when an app has a known URL and needs markdown, HTML, or metadata.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add firecrawl/skills --skill firecrawl-build-scrape -a claude-code
Open on GitHub

What firecrawl-build-scrape does

The skill guides the integration of Firecrawl /scrape into applications written in Node, Python, and other supported runtimes. It targets features that start with a known URL. By default, it recommends extracting markdown and passing onlyMainContent to strip out navigation menus and clutter. If a page requires clicks or multi-step navigation, this skill is not sufficient: you must escalate to firecrawl-build-interact.

The rules address caching and data freshness directly. Firecrawl reuses indexed data by default, so setting maxAge: 0 forces a live read when stale content cannot be tolerated. The response metadata exposes cacheState and cachedAt to verify origin details. Hosted requests require FIRECRAWL_API_KEY. For self-hosted deployments, the optional FIRECRAWL_API_URL configures the custom base URL.

What it helps with

  • extract markdown and metadata from a specific URL
  • strip navigation boilerplate using onlyMainContent
  • control cache freshness with maxAge and inspect cacheState
  • integrate the Firecrawl /scrape endpoint into backend code

Example prompts for the agent

  • Write a TypeScript function that calls Firecrawl /scrape for a given URL and returns clean markdown using onlyMainContent
  • Integrate Firecrawl /scrape in Python with maxAge set to 0 to bypass cached page copies

How to install firecrawl-build-scrape

1Skills CLI (Vercel)

npx skills add firecrawl/skills --skill firecrawl-build-scrape -a claude-code

2Manually: put the files in place

~/.claude/skills/firecrawl-build-scrape/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/firecrawl-build-scrape/

From the same set4

The whole set →

Similar

browser browserbase Automates browser navigation via the browse CLI. Useful for data extraction, filling forms, and navigating sites behind bot protection. Claude Code CX Codex Cursor +1 5,900installs browseros-neo browseros-ai Routes website tasks to BrowserOS neo, using a browser with a persistent profile and active account sessions. Use it for forms, downloads, page checks, and account actions. Claude Code CX Codex Cursor +1 604installs tavily-best-practices tavily-ai This skill gives an agent guidance for Tavily web search, content extraction, site crawling, and research. Use it when adding current web data to an agent workflow or RAG system. Claude Code CX Codex Cursor +1 20,600installs control-ui cursor Inspects and tests local web, IDE, or Electron interfaces via browser automation and CDP. Captures screenshots, traces, and verifies UI changes without extra dependencies. Claude Code CX Codex Cursor +1 2,400installs agent-browser vercel-labs A CLI skill for browser control: it opens pages, fills forms, clicks buttons, and tests web apps. Use it when an agent needs to act inside a website. Claude Code CX Codex Cursor +1 1,200,000installs webapp-testing official anthropics This skill tests local web apps with Playwright, helping agents debug UI behavior, capture screenshots, and inspect browser logs. Claude Code Claude.ai 186,758installs computer-use stablyai This skill drives a visible app window through orca computer: accessibility tree, clicks, typing, screenshots. Reach for it when the job sits behind a GUI. Claude Code CX Codex Cursor +1 239,000installs browser-use browser-use Hands the agent a real Chrome over CDP: clicks, typing, screenshots, and pages that need JS or your logged-in session. Claude Code CX Codex Cursor +1 98,100installs

Questions about firecrawl-build-scrape

How to install firecrawl-build-scrape in Claude Code?

Run npx skills add firecrawl/skills --skill firecrawl-build-scrape -a claude-code in your terminal.

What does firecrawl-build-scrape do?

The skill instructs AI coding assistants how to implement the Firecrawl /scrape endpoint for single-page extraction. It provides guidelines for payload formats, noise filtering, and cache headers.

When should you switch from firecrawl-build-scrape to firecrawl-build-interact?

If accessing the page content requires clicks, form inputs, or multi-step browser actions, the /scrape endpoint is insufficient. The skill requires escalating to firecrawl-build-interact for interactive flows.

Source text

SKILL.md · ISC
---
name: firecrawl-build-scrape
description: Integrate Firecrawl `/scrape` into product code for single-page extraction. Use when an app already has a URL and needs markdown, HTML, links, screenshots, metadata, or structured page output. Prefer this skill over broader crawl patterns when the feature is page-level.
license: ISC
metadata:
  author: firecrawl
  version: "0.1.0"
  homepage: https://www.firecrawl.dev
  source: https://github.com/firecrawl/skills
inputs:
  - name: FIRECRAWL_API_KEY
    description: Firecrawl API key for hosted Firecrawl requests.
    required: true
  - name: FIRECRAWL_API_URL
    description: Optional base URL for self-hosted Firecrawl deployments.
    required: false
references:
  - references/freshness-and-liveness.md
---

# Firecrawl Build Scrape

Use this when the application already has the URL and needs content from one page.

## Use This When

- the feature starts from a known URL
- you need page content for retrieval, summarization, enrichment, or monitoring
- you want the default extraction primitive before considering `/interact`

## Default Recommendations

- Return `markdown` unless the feature truly needs another format.
- Use `onlyMainContent` for article-like pages where nav and chrome add noise.
- Add waits or other rendering options only when the page needs them.

## Freshness and Liveness

- Firecrawl reuses recently indexed content, which is what makes repeat reads of the same URL fast. Set `maxAge` (milliseconds) to bound how old a reused copy may be, or `maxAge: 0` to skip index reuse for a freshness-critical read.
- Read `metadata.cacheState` and `metadata.cachedAt` to see what you actually got.
- A successful scrape reports what the page returned. Whether the thing the page describes is still active is a source-specific judgment your code makes.
- See [references/freshness-and-liveness.md](references/freshness-and-liveness.md) for the tradeoff, the metadata, and the decision rule.

## Common Product Patterns

- knowledge ingestion from known URLs
- enrichment from a company, product, or docs page
- pricing, changelog, and documentation extraction
- page-level quality checks or monitoring

## Escalation Rules

- If you do not have the URL yet, start with [firecrawl-build-search](../firecrawl-build-search/SKILL.md).
- If content requires clicks, typing, or multi-step navigation, escalate to [firecrawl-build-interact](../firecrawl-build-interact/SKILL.md).

## Implementation Notes

- Keep the integration narrow: one feature, one URL, one extraction contract.
- Treat `/scrape` as the default primitive for downstream LLM or indexing pipelines.
- Request richer formats only when the consumer needs them, such as links, screenshots, or branding data.

## Docs (Source of Truth)

Read the source-of-truth page for your project language before writing integration code:

- **Node / TypeScript**: [docs.firecrawl.dev/agent-source-of-truth/node](https://docs.firecrawl.dev/agent-source-of-truth/node)
- **Python**: [docs.firecrawl.dev/agent-source-of-truth/python](https://docs.firecrawl.dev/agent-source-of-truth/python)
- **Rust**: [docs.firecrawl.dev/agent-source-of-truth/rust](https://docs.firecrawl.dev/agent-source-of-truth/rust)
- **Java**: [docs.firecrawl.dev/agent-source-of-truth/java](https://docs.firecrawl.dev/agent-source-of-truth/java)
- **Elixir**: [docs.firecrawl.dev/agent-source-of-truth/elixir](https://docs.firecrawl.dev/agent-source-of-truth/elixir)
- **cURL / REST**: [docs.firecrawl.dev/agent-source-of-truth/curl](https://docs.firecrawl.dev/agent-source-of-truth/curl)

## See Also

- [firecrawl-build](../firecrawl-build/SKILL.md)
- [firecrawl-build-search](../firecrawl-build-search/SKILL.md)
- [firecrawl-build-interact](../firecrawl-build-interact/SKILL.md)

© firecrawl · ISC · firecrawl/skills

See also

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor