# realtime-cinema-data-engineering-pipeline

Instructions for assembling a streaming pipeline that routes simulated ticket transactions through message queues and warehouse layers.

- skill · `type=skill` · Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, OpenCode · 2000 installs · ★ 5
- Author: reason-machines
- License: LicenseRef-Unknown · policy=link-only · description only; the file stays with the author
- Source: https://github.com/reason-machines/data-skills/tree/HEAD/skills/realtime-cinema-data-engineering-pipeline/SKILL.md
- Updated: 2026-10-09
- HTML: https://affpapa.org/en/nevibecode/skills/realtime-cinema-data-engineering-pipeline

## What it does

This skill guides your coding assistant through setting up event streaming for cinema box office records. Synthetic ticket purchases generated via Faker land in an Apache Kafka topic, while a background consumer loads raw payloads directly into PostgreSQL.

Data organization follows a tiered setup. The bronze tier keeps raw JSON payloads, the silver tier breaks details into normalized third-normal-form relational tables, and the gold tier prepares materialized aggregates for Streamlit reports. Airflow schedules and runs the downstream transformations.

Running this setup requires Python 3.8+ alongside Docker Compose. Without waiting two or three minutes after starting the containers, Airflow will not finish its boot process and scheduled tasks will fail.

## Requirements
- Works with: PostgreSQL

## Install

### Claude Code (native platform)

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill realtime-cinema-data-engineering-pipeline -a claude-code
```

2. **Manually: put the files in place**
- File: `~/.claude/skills/realtime-cinema-data-engineering-pipeline/SKILL.md` — Copy the whole skill folder; for one project use .claude/skills/realtime-cinema-data-engineering-pipeline/

### Codex

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill realtime-cinema-data-engineering-pipeline -a codex
```

2. **Manually: put the files in place**
- File: `.agents/skills/realtime-cinema-data-engineering-pipeline/SKILL.md` — For all projects use ~/.agents/skills/

### Cursor

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill realtime-cinema-data-engineering-pipeline -a cursor
```

2. **Manually: put the files in place**
- File: `.cursor/skills/realtime-cinema-data-engineering-pipeline/SKILL.md` — Cursor also reads .agents/skills/ and .claude/skills/

### GitHub Copilot

1. **GitHub CLI**
```bash
gh skill install reason-machines/data-skills realtime-cinema-data-engineering-pipeline
```

2. **Manually: put the files in place**
- File: `.github/skills/realtime-cinema-data-engineering-pipeline/SKILL.md`

### Gemini CLI

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill realtime-cinema-data-engineering-pipeline -a gemini-cli
```

2. **Platform CLI**
```bash
gemini skills install https://github.com/reason-machines/data-skills --path skills/realtime-cinema-data-engineering-pipeline
```

### Windsurf (Devin Desktop)

**Manually: put the files in place**
- File: `.devin/skills/realtime-cinema-data-engineering-pipeline/SKILL.md` — The legacy .windsurf/skills/ path still works

### OpenCode

**Skills CLI (Vercel)**
```bash
npx skills add reason-machines/data-skills --skill realtime-cinema-data-engineering-pipeline -a opencode
```

### Claude.ai

**Claude.ai**
- Zip the folder and upload it in Settings → Capabilities → Skills

Where a file is given instead of a command, copy the files from the source to that path: https://github.com/reason-machines/data-skills/tree/HEAD/skills/realtime-cinema-data-engineering-pipeline/SKILL.md

## When to use it
- ingest continuous event streams from Kafka into PostgreSQL
- structure database storage into bronze, silver, and gold tiers
- mock ticket purchasing events using Python and Faker
- orchestrate relational transformations with Apache Airflow

## Example prompts
- Set up a streaming event pipeline using Kafka, PostgreSQL, and Airflow
- Show me how to split cinema event payloads into normalized silver tables
- Generate synthetic movie ticket sales with a Kafka producer script

## Similar
- [neon-realtime](https://affpapa.org/en/nevibecode/skills/neon-realtime.md) — skill · 6000 installs
- [postgresql-database-engineering](https://affpapa.org/en/nevibecode/skills/postgresql-database-engineering.md) — skill · 1800 installs
- [turbo-builder](https://affpapa.org/en/nevibecode/skills/turbo-builder.md) — skill · 3600 installs
- [digitalocean-managed-databases](https://affpapa.org/en/nevibecode/skills/digitalocean-managed-databases.md) — skill · 393 installs
- [typescript-e2e-testing](https://affpapa.org/en/nevibecode/skills/typescript-e2e-testing.md) — skill · 2300 installs
- [data-engineer](https://affpapa.org/en/nevibecode/agents/data-engineer.md) — subagent · 3194 installs

From the same set: [reason-machines/data-skills](https://affpapa.org/en/nevibecode/by/reason-machines/data-skills.md) — 74 cards

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md