Skip to main content
affpapa.org
RU EN
skill

data-engineer — Claude Code skill: setup

This skill helps plan data pipelines, warehouses, and streaming systems. Use it when a project needs ingestion, orchestration, or data quality checks.

Install into Claude Code · claude-code-templates All methods and platforms ↓ 
npx claude-code-templates@latest --skill ai-research/data-engineer
Open on GitHub

What data-engineer does

The skill gives Claude Code a data-engineering workflow. It starts with sources, SLAs, and data contracts, then covers architecture, storage, orchestration, ingestion, transformation, validation, and monitoring. The guidance spans batch and streaming designs.

Its listed stack includes Apache Spark, dbt, Apache Airflow, Kafka, Flink, lakehouse technologies, and data services from AWS, Azure, and GCP. It also covers warehouse modeling, lineage, governance, access control, and checks before data reaches production sinks.

The project needs access to data sources or storage systems. That limitation matters: the skill is not intended for exploratory analysis alone or for ML model work without pipelines.

What it helps with

  • design a batch or streaming data pipeline
  • plan a warehouse or lakehouse architecture
  • map ingestion, transformation, and validation stages
  • choose orchestration with Apache Airflow
  • set up data quality and lineage checks

Example prompts for the agent

  • Design a batch pipeline and define its sources, SLAs, data contracts, and validation stages.
  • Compare lakehouse options built around Apache Spark, dbt, and Apache Airflow, including data quality checks.
  • Plan Kafka and Flink stream processing with PII protection and access control.

How to install data-engineer

1claude-code-templates

npx claude-code-templates@latest --skill ai-research/data-engineer

2Skills CLI (Vercel)

npx skills add davila7/claude-code-templates --skill data-engineer -a claude-code

3Manually: put the files in place

~/.claude/skills/data-engineer/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/data-engineer/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about data-engineer

How do I install data-engineer in Claude Code?

Run npx claude-code-templates@latest --skill ai-research/data-engineer. This installs the data-engineer skill for Claude Code.

What does the data-engineer skill do?

It guides pipeline, warehouse, and streaming design, including tool selection, orchestration, validation, data quality, and lineage.

What does data-engineer require to work?

The project needs access to data sources or storage systems. The skill also works with source definitions, SLAs, data contracts, and PII protection requirements.

Similar skills

All skills for Data and databases →
xlsx official anthropics Creates, reads, edits, and converts spreadsheet files. Use it when the requested deliverable is an Excel workbook or another tabular file. 187,223installs google-agents-cli-observability official Google This skill guides you through tracing and monitoring AI agents, including ADK agents. Use it when you need to inspect agent execution or monitor a deployed agent. CX Codex +1 511,300installs caveman-evidence-review JuliusBrussee A read-only skill reviews Caveman Cloud evidence on LLM spend, traces, and routing. Use it to see where a project’s model budget goes. CX Codex +1 104,500installs migration JuliusBrussee Enforces reversible, compatibility-safe transitions for schema, data, and API updates. Useful whenever data loss or rollout downtime is unacceptable. CX Codex +1 103,900installs performance-optimization addyosmani An agent skill that measures before it changes code: Core Web Vitals budgets, N+1 queries, missing indexes and slow endpoints. CX Codex +1 65,200installs supabase official supabase Guides the agent through database configuration and strict RLS policies in Supabase. CX Codex GP ChatGPT 8installs

From the same set495

The whole set →
astro This skill guides Astro projects with Markdown or MDX content and selectively hydrated interactive components. Use it for blogs, documentation, and portfolio sites. 157installs cloud-architect A Claude skill for designing infrastructure across AWS, Azure and GCP, with Terraform, CDK, cost work and security controls. 157installs behavioral-modes Gives the agent a set of operating modes, from brainstorming to shipping. Useful when replies should match the kind of task at hand. 157installs peer-review Review scientific manuscripts and grant proposals with checks for methods, statistics, reproducibility, ethics, and reporting. Use it to structure a critical review across research fields. 154installs pubmed-database A Claude skill for PubMed access over the E-utilities REST API: MeSH queries, batch fetches, citation matching by PMID or DOI. 149installs prompt-engineering-dspy Learn to structure language-model tasks with DSPy, assemble RAG workflows, and tune modules from examples. Useful when a project needs more than a hand-written prompt. 147installs typescript-pro Get help with advanced TypeScript types, generic constraints, and strict compiler settings. Use it when shaping shared contracts or diagnosing difficult type inference. 146installs timeline-compressor Compresses a real-world timeline into fast simulation cycles so you can test decisions and risks sooner. Useful before you commit to a plan. 146installs

Project sponsors

Companies that keep this analytics open
Gold sponsor
Nutra.Club

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor