# amee-joshi-data-engineering-portfolio

A reference skill with Azure data engineering examples: Bronze–Silver–Gold layers, Delta Lake, dimensional models and pipeline designs.

- skill · `type=skill` · Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, OpenCode · 2000 installs · ★ 5
- Author: reason-machines
- License: LicenseRef-Unknown · policy=link-only · description only; the file stays with the author
- Source: https://github.com/reason-machines/data-skills/tree/HEAD/skills/amee-joshi-data-engineering-portfolio/SKILL.md
- Updated: 2026-10-09
- HTML: https://affpapa.org/en/nevibecode/skills/amee-joshi-data-engineering-portfolio

## What it does

The skill hands your agent a set of worked patterns for cloud data platforms. It covers Medallion architecture on Delta Lake, a metadata-driven ingestion framework, a star schema in SQL Server and BI reporting examples. Ask the agent to sketch a pipeline layout or lakehouse layers and it works from these samples instead of inventing a structure.

Three projects carry the material: a retail lakehouse on Azure Databricks, configuration-based loading through Azure Data Factory, and a warehouse built on a star schema. The details are concrete — metadata columns added during Bronze ingestion, cleansing and deduplication in Silver, SCD Type 2 handled by a Delta `merge`, SCD Type 1 by SQL `MERGE`. Treat it as a reference, not a library. The code assumes PySpark, Delta Lake and Azure services, and it will not run without them.

Handy when you want to check your layer split against a working example or explain an incremental loader to a teammate. On a stack outside Azure or without Databricks you will rewrite the samples — copying them as-is does not carry over.

## Requirements
- Works with: Azure

## Install

### Claude Code (native platform)

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill amee-joshi-data-engineering-portfolio -a claude-code
```

2. **Manually: put the files in place**
- File: `~/.claude/skills/amee-joshi-data-engineering-portfolio/SKILL.md` — Copy the whole skill folder; for one project use .claude/skills/amee-joshi-data-engineering-portfolio/

### Codex

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill amee-joshi-data-engineering-portfolio -a codex
```

2. **Manually: put the files in place**
- File: `.agents/skills/amee-joshi-data-engineering-portfolio/SKILL.md` — For all projects use ~/.agents/skills/

### Cursor

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill amee-joshi-data-engineering-portfolio -a cursor
```

2. **Manually: put the files in place**
- File: `.cursor/skills/amee-joshi-data-engineering-portfolio/SKILL.md` — Cursor also reads .agents/skills/ and .claude/skills/

### GitHub Copilot

1. **GitHub CLI**
```bash
gh skill install reason-machines/data-skills amee-joshi-data-engineering-portfolio
```

2. **Manually: put the files in place**
- File: `.github/skills/amee-joshi-data-engineering-portfolio/SKILL.md`

### Gemini CLI

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill amee-joshi-data-engineering-portfolio -a gemini-cli
```

2. **Platform CLI**
```bash
gemini skills install https://github.com/reason-machines/data-skills --path skills/amee-joshi-data-engineering-portfolio
```

### Windsurf (Devin Desktop)

**Manually: put the files in place**
- File: `.devin/skills/amee-joshi-data-engineering-portfolio/SKILL.md` — The legacy .windsurf/skills/ path still works

### OpenCode

**Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill amee-joshi-data-engineering-portfolio -a opencode
```

### Claude.ai

**Claude.ai**
- Zip the folder and upload it in Settings → Capabilities → Skills

Where a file is given instead of a command, copy the files from the source to that path: https://github.com/reason-machines/data-skills/tree/HEAD/skills/amee-joshi-data-engineering-portfolio/SKILL.md

## When to use it
- split a pipeline into Bronze, Silver and Gold layers
- set up incremental loading from SQL Server on a watermark column
- write SCD Type 2 logic for a Delta dimension table
- design a star schema for a SQL Server warehouse
- show a data engineering project layout as a worked example

## Example prompts
- Show me a Medallion architecture example for a Databricks retail lakehouse
- How do I implement SCD Type 2 in a Delta table with merge?
- Build the config for incremental ingestion of the orders table from SQL Server

## Similar
- [xlsx](https://affpapa.org/en/nevibecode/skills/xlsx.md) — skill · 187223 installs
- [google-agents-cli-observability](https://affpapa.org/en/nevibecode/skills/google-agents-cli-observability.md) — skill · 511300 installs
- [caveman-evidence-review](https://affpapa.org/en/nevibecode/skills/caveman-evidence-review.md) — skill · 104500 installs
- [migration](https://affpapa.org/en/nevibecode/skills/migration.md) — skill · 103900 installs
- [performance-optimization](https://affpapa.org/en/nevibecode/skills/performance-optimization.md) — skill · 65200 installs
- [supabase](https://affpapa.org/en/nevibecode/skills/supabase.md) — skill · 8 installs

From the same set: [reason-machines/data-skills](https://affpapa.org/en/nevibecode/by/reason-machines/data-skills.md) — 31 cards

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md