Skip to main content
skill CX Codex

databricks-jobs — Databricks skill: what it does, how to install

Teaches your coding agent to build and ship Lakeflow Jobs on Databricks: tasks, dependencies, triggers, alerts. Useful when a new data pipeline should be defined in code, not clicked together.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add databricks/databricks-agent-skills --skill databricks-jobs -a claude-code
Open on GitHub

What databricks-jobs does

The skill spells out how an agent should assemble a job: a DAG of tasks, launch conditions such as ALL_SUCCESS or ALL_DONE, and schedules driven by cron, a file landing, or a Unity Catalog table change. Reference material inside covers task kinds (notebook, Python, SQL, dbt, pipeline, JAR, run_job, for_each), monitoring settings, and worked ETL examples.

A new project gets scaffolded non-interactively with databricks bundle init and a config file, which also drops an AGENTS.md into the tree. You then declare the job in one of three ways: DABs in resources/jobs.yml, the Python SDK with w.jobs.create, or databricks jobs create from the CLI. Compute defaults to serverless, so leave cluster blocks alone unless you have a reason.

You need the databricks CLI at v1.0.0 or newer. Auth and profile choice live in the parent databricks-core skill. Serverless versus classic and the performance mode belong to databricks-serverless; this skill tells the agent to consult that one before any cluster setting lands in the config.

What it helps with

  • chain several notebook, SQL and Python tasks into one DAG
  • scaffold a job project without interactive prompts
  • start a job when a file arrives or a table changes
  • add retries, timeouts and failure alerts
  • move an existing job definition into a declarative bundle

Example prompts for the agent

  • Create a Lakeflow Job with extract and transform tasks, where the second depends on the first.
  • Write the job definition into resources/jobs.yml and run it with databricks bundle.
  • I need a job that fires whenever a new file shows up in the landing directory.

How to install databricks-jobs

1Skills CLI (Vercel)

npx skills add databricks/databricks-agent-skills --skill databricks-jobs -a claude-code

2Manually: put the files in place

~/.claude/skills/databricks-jobs/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/databricks-jobs/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about databricks-jobs

How do I install databricks-jobs in Claude Code?

Run npx skills add databricks/databricks-agent-skills --skill databricks-jobs -a claude-code. The skill file lands at ~/.claude/skills/databricks-jobs/SKILL.md.

What is databricks-jobs for?

It gives the agent guidance on defining and deploying Lakeflow Jobs — task types, run_if conditions, triggers, monitoring — using DABs, the Python SDK or the CLI.

Does it replace databricks-serverless?

No, they cover different ground. databricks-serverless picks serverless or classic and the performance mode. databricks-jobs describes the job itself. The skill asks the agent to check serverless first, before touching cluster settings.

Similar skills

All skills for Data and databases →

From the same set12

databricks-core Guides Databricks CLI work around authentication, profile choice, and bundles. Use it before CLI tasks involving Databricks resources. CX Codex +1 1,700installs databricks-pipelines Guides agents in designing Lakeflow Spark Declarative Pipelines on Databricks with Python or SQL. It selects dataset types and configures Auto CDC before coding begins. CX Codex +1 987installs databricks-model-serving A skill that steers the agent through Databricks Model Serving endpoint work: creation, version swaps, traffic splits, logs. Useful when model rollouts go through CLI or MLflow. CX Codex +1 715installs databricks-vector-search Skill for creating Databricks vector indexes and querying embeddings in Delta tables. Useful for RAG applications and semantic search. CX Codex +1 380installs databricks-dbsql Equips your coding agent with advanced Databricks SQL patterns, pipe syntax, H3 geospatial functions, and embedded LLM queries. CX Codex +1 364installs databricks-unity-catalog Helps agents handle Unity Catalog permissions, configure row filters and column masks, manage storage, and query system tables in Databricks. CX Codex +1 325installs databricks-docs Fetches official Databricks platform documentation through the llms.txt index. It helps when you need verified API parameters or lakehouse reference guides. CX Codex +1 310installs databricks-apps-python Configures Python backends for Databricks Apps, handling framework deployment, OAuth authentication, and Lakebase connections. CX Codex +1 305installs

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor