zyte-web-data — Claude Code scraping plugin: setup and use
Turn a site URL and an extraction request into a tested Scrapy project. Useful for product catalogs, job listings, and other pages with repeating structured content.
/plugin install zyte-web-data@claude-plugins-official
/plugin marketplace add anthropics/claude-plugins-community
/plugin install zyte-web-data@claude-community
/plugin marketplace add anthropics/claude-plugins-officialWhat zyte-web-data does
Give the plugin a URL and say which fields you need. It explores the site, proposes an extraction schema for your approval, then builds a Scrapy project with web-poet page objects and test fixtures. The /scrape workflow plans the extraction before generating the spider and running a smoke test.
Run the generated spider locally with uv run scrapy crawl <spider_name> and test it with uv run pytest fixtures/. The project uses uv; its dependencies, including scrapy and pytest, are installed automatically. A Zyte account is needed for Scrapy Cloud or Zyte API. JavaScript browser rendering requires a Zyte API key.
Use /zyte to deploy a project to Scrapy Cloud. Zyte MCP is declared by the plugin, so there is no need to add it separately with claude mcp add; sign in from an active Claude Code session using /mcp.
What it helps with
- extract requested fields from a site URL
- build a Scrapy project for a product catalog or job listings
- run spider tests and a smoke test
- deploy a project to Scrapy Cloud
Example prompts for the agent
- Create a spider to collect product names and prices from this URL.
- Propose an extraction schema for these listing pages, then build and test the Scrapy project.
- Deploy the finished project to Scrapy Cloud.
How to install zyte-web-data
Plugin marketplace
/plugin install zyte-web-data@claude-plugins-official/plugin marketplace add anthropics/claude-plugins-community/plugin install zyte-web-data@claude-community/plugin marketplace add anthropics/claude-plugins-officialStep by step, with commands for each platform: Claude Code plugins: marketplaces, installing, and building your own
Questions about zyte-web-data
How do I install zyte-web-data in Claude Code?
Add the official marketplace with /plugin marketplace add anthropics/claude-plugins-official, then install the plugin with /plugin install zyte-web-data@claude-plugins-official.
What does zyte-web-data do?
It explores a site, proposes fields for extraction, and generates a tested Scrapy project with web-poet page objects from a URL and your request.
Do I need a Zyte account to run a spider locally?
No. The generated project runs locally with uv. A Zyte account is needed for Scrapy Cloud or Zyte API, and browser rendering of JavaScript pages requires a Zyte API key.
