# zomato-ai-data-engineering-pipeline

zomato-ai-data-engineering-pipeline is a Claude Code skill for building a food delivery batch pipeline across S3, Snowflake, dbt, and Airflow, with OpenAI for review enrichment and text-to-SQL.

- skill · `type=skill` · Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, OpenCode, Windsurf (Devin Desktop), Claude.ai · 128 installs · ★ 5 repo stars
- Author: reason-machines
- License: not stated · policy=link-only · description only; the file stays with the author
- Source: https://github.com/reason-machines/data-skills/tree/HEAD/skills/zomato-ai-data-engineering-pipeline/SKILL.md
- Updated: 2026-10-09
- Security check: automated, 2026-11-16 (text) — no signs of malicious code found.
- HTML: https://affpapa.org/en/nevibecode/skills/zomato-ai-data-engineering-pipeline

## What it does

This skill provides setup steps and SQL patterns for a food delivery medallion architecture. Raw CSV files land in Amazon S3 and load into Snowflake Bronze tables through a dedicated storage integration and external stage.

Transformations run through dbt. Silver views clean and cast seven source tables, while Gold marts manage business metrics, incremental facts, and SCD2 snapshots. Airflow runs via Docker Compose to handle scheduled pipeline tasks.

Ingestion halts if Snowflake external IDs and AWS IAM trust policies are mismatched. Running RAG searches or SQL generation also demands an active `OPENAI_API_KEY` in your environment.

## Requirements
- Works with: Snowflake

## Install

### Claude Code (native platform)

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill zomato-ai-data-engineering-pipeline -a claude-code
```

2. **Manually: put the files in place**
- File: `~/.claude/skills/zomato-ai-data-engineering-pipeline/SKILL.md` — Copy the whole skill folder; for one project use .claude/skills/zomato-ai-data-engineering-pipeline/

### Codex

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill zomato-ai-data-engineering-pipeline -a codex
```

2. **Manually: put the files in place**
- File: `.agents/skills/zomato-ai-data-engineering-pipeline/SKILL.md` — For all projects use ~/.agents/skills/

### Cursor

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill zomato-ai-data-engineering-pipeline -a cursor
```

2. **Manually: put the files in place**
- File: `.cursor/skills/zomato-ai-data-engineering-pipeline/SKILL.md` — Cursor also reads .agents/skills/ and .claude/skills/

### GitHub Copilot

1. **GitHub CLI**
```bash
gh skill install reason-machines/data-skills skills/zomato-ai-data-engineering-pipeline
```

2. **Manually: put the files in place**
- File: `.github/skills/zomato-ai-data-engineering-pipeline/SKILL.md`

### Gemini CLI

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill zomato-ai-data-engineering-pipeline -a gemini-cli
```

2. **Platform CLI**
```bash
gemini skills install https://github.com/reason-machines/data-skills --path skills/zomato-ai-data-engineering-pipeline
```

### Windsurf (Devin Desktop)

**Manually: put the files in place**
- File: `.devin/skills/zomato-ai-data-engineering-pipeline/SKILL.md` — The legacy .windsurf/skills/ path still works

### OpenCode

**Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill zomato-ai-data-engineering-pipeline -a opencode
```

### Claude.ai

**Claude.ai**
- Zip the folder and upload it in Settings → Capabilities → Skills

Where a file is given instead of a command, copy the files from the source to that path: https://github.com/reason-machines/data-skills/tree/HEAD/skills/zomato-ai-data-engineering-pipeline/SKILL.md

## When to use it
- Configure external stage ingestion from S3 into Snowflake RAW
- Build dbt staging and mart models across medallion layers
- Orchestrate batch workflow runs using Apache Airflow in Docker
- Set up OpenAI integration for review enrichment and text-to-SQL

## Example prompts
- Help me configure the Snowflake storage integration for an S3 bucket
- Build the dbt staging view for cleaning raw restaurant data
- Generate docker compose environment settings for Airflow and Snowflake

## Similar
- [data-engineering](https://affpapa.org/en/nevibecode/skills/travisjneuman-data-engineering.md) — skill · 105 installs
- [snowflake-data-engineering-cursorrules-prompt-file](https://affpapa.org/en/nevibecode/rules/snowflake-data-engineering-cursorrules-prompt-file.md) — rule · ★ 41178 repo stars
- [data-warehouse-experimentation](https://affpapa.org/en/nevibecode/skills/data-warehouse-experimentation.md) — skill · 283 installs
- [dbt-sf-to-bq-translator](https://affpapa.org/en/nevibecode/skills/dbt-sf-to-bq-translator.md) — skill · 2300 installs
- [snowflake-development](https://affpapa.org/en/nevibecode/skills/snowflake-development.md) — skill · 25 installs
- [snowflake-snowpark-dbt-cursorrules-prompt-file](https://affpapa.org/en/nevibecode/rules/snowflake-snowpark-dbt-cursorrules-prompt-file.md) — rule · ★ 41178 repo stars

From the same set: [reason-machines/data-skills](https://affpapa.org/en/nevibecode/by/reason-machines/data-skills.md) — 82 cards

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md
