# databricks-execution-compute

databricks-execution-compute is a skill that runs code on Databricks and helps choose a compute mode for Spark scripts, longer jobs, and interactive clusters.

- skill · `type=skill` · Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, OpenCode, Windsurf (Devin Desktop), Claude.ai · 359 installs · ★ 408 repo stars
- Author: databricks
- License: not stated · policy=link-only · description only; the file stays with the author
- Source: https://github.com/databricks/databricks-agent-skills/tree/HEAD/skills/databricks-execution-compute/SKILL.md
- Updated: 2026-11-03
- Security check: automated, 2026-11-16 (text) — no signs of malicious code found.
- HTML: https://affpapa.org/en/nevibecode/skills/databricks-execution-compute

## What it does

This skill guides code execution on Databricks with Python, Scala, SQL, or R. It points Spark workloads toward Databricks Connect and longer-running work, such as ML, toward serverless jobs. Read the reference for the selected mode before running it. The skill requires Databricks CLI version 1.0.0 or later; `databricks-core` covers CLI setup and authentication.

The CLI workflow can upload a notebook, submit a job, check its state, and retrieve its output. It also supports cluster discovery and compute management. Interactive clusters take 3–8 minutes to start and incur charges while running, so the skill advises against launching one without a clear need.

## Requirements
- Works with: Databricks

## Install

### Claude Code (native platform)

1. **Skills CLI (Vercel)**
```bash
npx skills add databricks/databricks-agent-skills --skill databricks-execution-compute -a claude-code
```

2. **Manually: put the files in place**
- File: `~/.claude/skills/databricks-execution-compute/SKILL.md` — Copy the whole skill folder; for one project use .claude/skills/databricks-execution-compute/

### Codex

1. **Skills CLI (Vercel)**
```bash
npx skills add databricks/databricks-agent-skills --skill databricks-execution-compute -a codex
```

2. **Manually: put the files in place**
- File: `.agents/skills/databricks-execution-compute/SKILL.md` — For all projects use ~/.agents/skills/

### Cursor

1. **Skills CLI (Vercel)**
```bash
npx skills add databricks/databricks-agent-skills --skill databricks-execution-compute -a cursor
```

2. **Manually: put the files in place**
- File: `.cursor/skills/databricks-execution-compute/SKILL.md` — Cursor also reads .agents/skills/ and .claude/skills/

### GitHub Copilot

1. **GitHub CLI**
```bash
gh skill install databricks/databricks-agent-skills skills/databricks-execution-compute
```

2. **Manually: put the files in place**
- File: `.github/skills/databricks-execution-compute/SKILL.md`

### Gemini CLI

1. **Skills CLI (Vercel)**
```bash
npx skills add databricks/databricks-agent-skills --skill databricks-execution-compute -a gemini-cli
```

2. **Platform CLI**
```bash
gemini skills install https://github.com/databricks/databricks-agent-skills --path skills/databricks-execution-compute
```

### Windsurf (Devin Desktop)

**Manually: put the files in place**
- File: `.devin/skills/databricks-execution-compute/SKILL.md` — The legacy .windsurf/skills/ path still works

### OpenCode

**Skills CLI (Vercel)**
```bash
npx skills add databricks/databricks-agent-skills --skill databricks-execution-compute -a opencode
```

### Claude.ai

**Claude.ai**
- Zip the folder and upload it in Settings → Capabilities → Skills

Where a file is given instead of a command, copy the files from the source to that path: https://github.com/databricks/databricks-agent-skills/tree/HEAD/skills/databricks-execution-compute/SKILL.md

## When to use it
- run a Spark script through Databricks Connect
- submit a long-running ML task as a serverless job
- check a run's status and retrieve its output
- find available clusters before choosing one

## Example prompts
- Run `my_spark_script.py` locally through Databricks Connect.
- Submit `train.py` as a serverless job and return its result.
- List clusters with `databricks clusters list --output json` and ask me which one to use.

## Similar
- [databricks-expert](https://affpapa.org/en/nevibecode/skills/databricks-expert.md) — skill · 215 installs
- [databricks-2025](https://affpapa.org/en/nevibecode/skills/databricks-2025.md) — skill · 168 installs
- [databricks](https://affpapa.org/en/nevibecode/rules/databricks.md) — rule · ★ 3589 repo stars
- [oracle-ai-data-platform-workbench-databricks-migrator](https://affpapa.org/en/nevibecode/plugins/oracle-ai-data-platform-workbench-databricks-migrator.md) — plugin · ★ 62 repo stars
- [data-engineering-patterns-fabric-databricks](https://affpapa.org/en/nevibecode/skills/data-engineering-patterns-fabric-databricks.md) — skill · 1600 installs
- [scala2](https://affpapa.org/en/nevibecode/rules/scala2.md) — rule · ★ 41430 repo stars

From the same set: [databricks/databricks-agent-skills](https://affpapa.org/en/nevibecode/by/databricks/databricks-agent-skills.md) — 30 cards

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md
