Skip to main content
skill CX Codex

senior-data-engineer · borghei — Claude Code skill: what it does, how to install

senior-data-engineer — a skill for Claude Code and Codex that automates data engineering workflows. Generates orchestrator DAGs, profiles data schemas, and flags query bottlenecks in Spark and SQL.

LicenseRef-MIT-Commons-Clause 199 installs ★ 1,183 updated 2026-11-08

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add borghei/Claude-Skills --skill senior-data-engineer -a claude-code
Open on GitHub

What senior-data-engineer does

The skill bundles three Python utilities: pipeline_orchestrator.py, data_quality_validator.py, and etl_performance_optimizer.py. Together they assemble batch or incremental DAGs for Airflow, Prefect, and Dagster, while also handling partition design.

Data validation runs against custom JSON contracts or generated Great Expectations suites, checking formats, missing values, and numeric bounds. SQL review via analyze-sql relies on static inspection. You still need query execution profiles from your warehouse to confirm actual runtimes and disk spills.

What it helps with

  • build incremental DAG configurations for Airflow, Prefect, or Dagster
  • generate JSON contracts and Great Expectations test suites from tabular data
  • detect schema drift and invalid records in CSV datasets
  • analyze Spark jobs and warehouse SQL queries to optimize partitioning

Example prompts for the agent

  • Generate an incremental Airflow DAG from PostgreSQL to Snowflake for orders and customers.
  • Validate sample_orders_flawed.csv against sample_schema.json with anomaly detection enabled.
  • Run static SQL analysis on assets/sample_query.sql targeting Snowflake.

How to install senior-data-engineer

1Skills CLI (Vercel)

npx skills add borghei/Claude-Skills --skill senior-data-engineer -a claude-code

2Manually: put the files in place

~/.claude/skills/senior-data-engineer/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/senior-data-engineer/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about senior-data-engineer

How to install senior-data-engineer in Claude Code?

Run npx skills add borghei/Claude-Skills --skill senior-data-engineer -a claude-code.

What does senior-data-engineer do?

It builds DAG files for popular orchestrators, validates tabular datasets against schemas, and optimizes data pipeline queries across SQL and Spark.

How does the SQL analysis tool work?

The bundled analyze-sql subcommand performs static checks on query syntax, meaning actual bottlenecks must be verified against query profiles inside the warehouse.

Similar skills

All skills for Data and databases →

senior-data-engineer by other authors comes first.

senior-data-engineer Alireza Rezvani senior-data-engineer is a Claude Code skill for designing data pipelines and ETL/ELT systems. It activates for architecture choices, orchestration, data quality checks, and troubleshooting. CX Codex +1 1,109installs senior-data-engineer Claude Skills Team senior-data-engineer — a skill for Claude and other agents: it helps design ETL/ELT and streaming pipelines, generates Airflow DAGs, Kafka configs and data quality checks. CX Codex +1 1installs data-pipeline-engineer curiositech data-pipeline-engineer guides data pipeline design, Medallion storage layers, Airflow DAG orchestration, and dbt models. Activates for batch processing and streaming workloads. CX Codex +1 215installs data-engineer davila7 data-engineer is a Claude Code skill for planning batch and streaming data pipelines. It joins work on warehouses, data quality, and orchestration. CX Codex +1 152installs data-engineering travisjneuman The data-engineering Claude Code skill covers data pipelines and warehouse schema design. It activates for ETL/ELT work, stream processing, and dbt transformations. CX Codex +1 105installs oracle-ai-data-platform-workbench-engineer-agent Oracle oracle-ai-data-platform-workbench-engineer-agent — a 37-skill agent for Oracle AI Data Platform Workbench: catalog discovery, Spark SQL, pipelines, governance and Delta Sharing, all driven by plain English. ★ 62repo stars realtime-cinema-data-engineering-pipeline reason-machines realtime-cinema-data-engineering-pipeline is a Claude Code skill for assembling a streaming pipeline that routes simulated cinema ticket transactions through message queues and warehouse layers. CX Codex +1 2,000installs discover-data rand discover-data is a Claude Code skill that loads data pipeline and ETL guides. It triggers on tasks with Airflow, stream processing, batch pipelines, and data validation. CX Codex +1 101installs

From the same set120

The whole set →
analytics-engineer analytics-engineer — a skill for Claude Code, Codex, Cursor, Copilot, Gemini CLI and OpenCode that builds dbt transformations and dimensional schemas. Triggered when you need SQL models, tests, incremental fact tables or metrics. CX Codex +1 207installs people-analytics The people-analytics skill examines workforce metrics, engagement surveys, pay equity, and employee flight risk. Use it when an HR question needs structured analysis or a prediction model. CX Codex +1 206installs senior-security senior-security is a Claude Code and Codex skill for threat modeling, code review, and secret scanning. It supports application security assessments and defensive architecture planning. CX Codex +1 203installs contract-and-proposal-writer The contract-and-proposal-writer skill drafts contracts, proposals, SOWs, NDAs, and MSAs around a chosen jurisdiction. Use it when preparing client-facing business documents. CX Codex +1 202installs coo-advisor coo-advisor is a Claude Code skill that advises on business operations, team capacity, recurring meetings, and workflow bottlenecks. CX Codex +1 199installs scrum-master scrum-master — a skill for Claude Code that computes sprint health scores and forecasts team velocity using past data. Evaluates retro action follow-through and calculates realistic capacity before planning. CX Codex +1 199installs ceo-advisor ceo-advisor guides executive planning, board meeting prep, and capital scenario modeling for leadership teams. CX Codex +1 198installs account-executive account-executive — a skill for managing deals: MEDDIC qualification, account planning, negotiations, and pipeline forecasting. Structures the entire sales cycle from discovery through contract signature. CX Codex +1 195installs

Project sponsors

Companies that keep this analytics open