# databricks-synthetic-data-gen

databricks-synthetic-data-gen creates synthetic Databricks data with Spark and Faker in Parquet, JSON, CSV, or Delta. Use it for test data, demos, and analysis-ready datasets.

- skill · `type=skill` · Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, OpenCode, Windsurf (Devin Desktop), Claude.ai · 314 installs · ★ 408 repo stars
- Author: databricks
- License: not stated · policy=link-only · description only; the file stays with the author
- Source: https://github.com/databricks/databricks-agent-skills/tree/HEAD/skills/databricks-synthetic-data-gen/SKILL.md
- Updated: 2026-10-24
- Security check: automated, 2026-11-16 (text) — no signs of malicious code found.
- HTML: https://affpapa.org/en/nevibecode/skills/databricks-synthetic-data-gen

## What it does

This skill generates synthetic Databricks data with Spark, Faker, and Pandas UDFs. It handles datasets from thousands to millions of rows and can write Parquet, JSON, CSV, or Delta output. Smaller sets below 10K rows may be generated locally and uploaded to volumes.

The agent asks for the catalog and schema, then lays out the tables, relationships, and assumptions before generation. It creates parent tables first and keeps child records linked through valid foreign keys. Data patterns include skew and incidents so the result can support investigation rather than a flat random sample.

\`databricks CLI` version `>= v1.0.0` is required. Catalog and schema must come from the user, so generation cannot start with those locations left undecided.

## Requirements
- Works with: Databricks

## Install

### Claude Code (native platform)

1. **Skills CLI (Vercel)**
```bash
npx skills add databricks/databricks-agent-skills --skill databricks-synthetic-data-gen -a claude-code
```

2. **Manually: put the files in place**
- File: `~/.claude/skills/databricks-synthetic-data-gen/SKILL.md` — Copy the whole skill folder; for one project use .claude/skills/databricks-synthetic-data-gen/

### Codex

1. **Skills CLI (Vercel)**
```bash
npx skills add databricks/databricks-agent-skills --skill databricks-synthetic-data-gen -a codex
```

2. **Manually: put the files in place**
- File: `.agents/skills/databricks-synthetic-data-gen/SKILL.md` — For all projects use ~/.agents/skills/

### Cursor

1. **Skills CLI (Vercel)**
```bash
npx skills add databricks/databricks-agent-skills --skill databricks-synthetic-data-gen -a cursor
```

2. **Manually: put the files in place**
- File: `.cursor/skills/databricks-synthetic-data-gen/SKILL.md` — Cursor also reads .agents/skills/ and .claude/skills/

### GitHub Copilot

1. **GitHub CLI**
```bash
gh skill install databricks/databricks-agent-skills skills/databricks-synthetic-data-gen
```

2. **Manually: put the files in place**
- File: `.github/skills/databricks-synthetic-data-gen/SKILL.md`

### Gemini CLI

1. **Skills CLI (Vercel)**
```bash
npx skills add databricks/databricks-agent-skills --skill databricks-synthetic-data-gen -a gemini-cli
```

2. **Platform CLI**
```bash
gemini skills install https://github.com/databricks/databricks-agent-skills --path skills/databricks-synthetic-data-gen
```

### Windsurf (Devin Desktop)

**Manually: put the files in place**
- File: `.devin/skills/databricks-synthetic-data-gen/SKILL.md` — The legacy .windsurf/skills/ path still works

### OpenCode

**Skills CLI (Vercel)**
```bash
npx skills add databricks/databricks-agent-skills --skill databricks-synthetic-data-gen -a opencode
```

### Claude.ai

**Claude.ai**
- Zip the folder and upload it in Settings → Capabilities → Skills

Where a file is given instead of a command, copy the files from the source to that path: https://github.com/databricks/databricks-agent-skills/tree/HEAD/skills/databricks-synthetic-data-gen/SKILL.md

## When to use it
- generate synthetic data for Databricks tests
- build related tables with valid foreign keys
- create a dataset for root-cause analysis demos
- write results as Parquet, JSON, CSV, or Delta

## Example prompts
- Generate synthetic customer churn data for a Databricks demo.
- Plan related tables for a payment outage scenario, then wait for my approval.
- Create test data in Delta after I provide the catalog and schema.

## Similar
- [oracle-ai-data-platform-workbench-databricks-migrator](https://affpapa.org/en/nevibecode/plugins/oracle-ai-data-platform-workbench-databricks-migrator.md) — plugin · ★ 62 repo stars
- [databricks-expert](https://affpapa.org/en/nevibecode/skills/databricks-expert.md) — skill · 215 installs
- [databricks-2025](https://affpapa.org/en/nevibecode/skills/databricks-2025.md) — skill · 168 installs
- [data-engineering-patterns-fabric-databricks](https://affpapa.org/en/nevibecode/skills/data-engineering-patterns-fabric-databricks.md) — skill · 1600 installs
- [azure-databricks-platform-architect](https://affpapa.org/en/nevibecode/agents/azure-databricks-platform-architect.md) — subagent · ★ 6505 repo stars
- [databricks](https://affpapa.org/en/nevibecode/rules/databricks.md) — rule · ★ 3589 repo stars

From the same set: [databricks/databricks-agent-skills](https://affpapa.org/en/nevibecode/by/databricks/databricks-agent-skills.md) — 30 cards

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md
