Skip to main content
skill CX Codex

data-engineering-patterns-fabric-databricks — Claude Code skill

data-engineering-patterns-fabric-databricks — a skill with 600+ data engineering patterns for Azure Databricks, Microsoft Fabric and PySpark: lakehouse architecture, Delta Lake, pipelines, cluster optimization.

no license 1,600 installs ★ 5 updated 2026-10-09

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add reason-machines/data-skills --skill data-engineering-patterns-fabric-databricks -a claude-code
Open on GitHub

What data-engineering-patterns-fabric-databricks does

The skill gives the agent access to field-tested patterns for building data pipelines in the Microsoft and Azure ecosystem. Inside are 12 PDF books organized by topic: pipelines and Data Factory in Fabric, lakehouse and PySpark, warehouse and SQL, Power BI, architecture patterns; clusters and compute in Databricks, Delta Lake, orchestration, streaming and Auto Loader, Unity Catalog, Databricks SQL and Photon, platform architecture and cost management.

Each pattern includes a problem statement, code sample and application context: incremental load with watermarks, data merge via MERGE, Delta table optimization with ZORDER, cluster autoscaling setup, table versioning through time travel. The agent pulls the pattern from the book and adapts it to the project context.

The skill requires manual repo cloning — PDFs live in Fabric Patterns/, Databricks Patterns/ and PySpark/ folders. After install, the agent references files by book name.

What it helps with

  • build an incremental pipeline with watermarks in Fabric
  • merge new records into a Delta table via MERGE
  • configure Databricks cluster autoscaling with Spot fallback
  • optimize Delta Lake with ZORDER and vacuum
  • organize metadata in Unity Catalog

Example prompts for the agent

  • Show incremental load patterns for Fabric Data Factory
  • How do I configure Databricks cluster autoscaling for production workloads?
  • Give me a Delta Lake merge pattern with update and insert

How to install data-engineering-patterns-fabric-databricks

1Skills CLI (Vercel)

npx skills add reason-machines/data-skills --skill data-engineering-patterns-fabric-databricks -a claude-code

2Manually: put the files in place

~/.claude/skills/data-engineering-patterns-fabric-databricks/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/data-engineering-patterns-fabric-databricks/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about data-engineering-patterns-fabric-databricks

How to install data-engineering-patterns-fabric-databricks in Claude Code?

Run npx skills add reason-machines/data-skills --skill data-engineering-patterns-fabric-databricks -a claude-code. The skill will appear in ~/.claude/skills/data-engineering-patterns-fabric-databricks/SKILL.md. Clone the repository manually after that so the agent can access the PDFs.

What does data-engineering-patterns-fabric-databricks do?

Gives the agent access to 600+ patterns for Azure Databricks, Microsoft Fabric and PySpark. Patterns cover lakehouses, Delta Lake, pipelines, orchestration, Unity Catalog, cluster optimization and cost management.

Which platforms does the skill cover?

Microsoft Fabric (250 patterns: pipelines, lakehouse, warehouse, Power BI, architecture) and Azure Databricks (350 patterns: clusters, Delta Lake, workflows, streaming, Unity Catalog, SQL, platform architecture). PySpark is covered in a separate handbook with 88 concepts.

Similar skills

All skills for Data and databases →

From the same set82

The whole set →
terraform-data-engineering-infrastructure terraform-data-engineering-infrastructure is a Claude Code skill for defining AWS infrastructure for data engineering with Terraform. It activates on requests to provision resources for data pipelines and analytics workloads. CX Codex +1 1,800installs snowflake-dbt-airbnb-analytics snowflake-dbt-airbnb-analytics guides coding assistants through building a Snowflake and dbt warehouse on Inside Airbnb datasets, from stage ingestion to Streamlit reporting. CX Codex +1 1,700installs harvard-artifacts-etl-pipeline harvard-artifacts-etl-pipeline is a Claude Code skill for building ETL workflows and collection dashboards. It activates for tasks involving the Harvard Art Museums API, SQL queries, or museum data visualization. CX Codex +1 1,700installs infrastructure-cicd-data-engineering The infrastructure-cicd-data-engineering skill guides Terraform delivery for data infrastructure through GitHub Actions and AWS OIDC. Use it when infrastructure changes need checks, approvals, and automated deployment. CX Codex +1 1,600installs game-analytics-platform-computer-vision game-analytics-platform-computer-vision guides the setup of a local fitness platform using computer vision, a Spring Boot backend, and a React dashboard for webcam workout tracking. CX Codex +1 1,600installs harvard-artifacts-etl-streamlit harvard-artifacts-etl-streamlit builds an ETL pipeline fetching Harvard Art Museums records into SQL and renders interactive Streamlit dashboards using Plotly. CX Codex +1 1,400installs harvard-artifacts-collection-analytics-app The harvard-artifacts-collection-analytics-app skill guides an ETL workflow and a Streamlit dashboard for Harvard Art Museums data. Use it when a Python and SQL analytics project needs API ingestion. CX Codex +1 1,400installs data-analytics-skills-claude data-analytics-skills-claude — a collection of analytics skills for checking data, investigating metrics, and shaping dashboard specs. Use it when an analysis needs a clear workflow and shareable results. CX Codex +1 1,300installs

More in the catalog

Project sponsors

Companies that keep this analytics open