Skip to main content
skill CX Codex

databricks-ml-training — Claude Code skill

databricks-ml-training is a skill for training classifiers and regressors on Databricks with XGBoost, scikit-learn, LightGBM, or PyTorch, and tracking runs with MLflow.

no license 354 installs ★ 408 updated 2026-10-24

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add databricks/databricks-agent-skills --skill databricks-ml-training -a claude-code
Open on GitHub

What databricks-ml-training does

This skill runs model training directly on a Databricks cluster instead of in the local Python process where your agent runs. Build classifiers and regressors with XGBoost, scikit-learn, LightGBM, or PyTorch, with MLflow tracking every run, parameter, and artifact. Models register to Unity Catalog and can then be scored in batch via Spark UDF or served real-time through databricks-model-serving.

Inside: hyperparameter search via Optuna, model versioning with movable aliases (@prod, @challenger), feature engineering backed by UC feature tables, point-in-time joins, materialized features, and streaming Kafka features. Custom PyFunc models are also supported. Requires Databricks CLI v0.294.0+. Training must always run as a serverless job on the cluster, never locally.

Do not use for endpoint management (databricks-model-serving) or MLflow-based model evaluation (databricks-mlflow-evaluation) — each has its own skill.

What it helps with

  • train a classifier on Databricks tables with hyperparameter tuning
  • register a model to Unity Catalog and swap production version via alias
  • score all rows in a Delta table using a registered model as a Spark UDF
  • build a feature pipeline with point-in-time joins and online store
  • log training runs to MLflow with automatic code snapshot and metrics

Example prompts for the agent

  • Train an XGBoost classifier on silver_turbine_features using Optuna hyperparameter search and register it to UC
  • Score the best model ai_demo_gen.wind_farm.turbine_failure@prod on all new records and write results to gold_predictions
  • Create a feature view with rolling window aggregations and apply it during training with feature store backtracking

How to install databricks-ml-training

1Skills CLI (Vercel)

npx skills add databricks/databricks-agent-skills --skill databricks-ml-training -a claude-code

2Manually: put the files in place

~/.claude/skills/databricks-ml-training/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/databricks-ml-training/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about databricks-ml-training

How do I install databricks-ml-training in Claude Code?

Run npx skills add databricks/databricks-agent-skills --skill databricks-ml-training -a claude-code, then read the instructions in ~/.claude/skills/databricks-ml-training/SKILL.md.

What does databricks-ml-training do?

It trains ML models on a Databricks cluster with MLflow and Unity Catalog integration. Supports XGBoost, scikit-learn, LightGBM, PyTorch, Optuna hyperparameter optimization, and batch scoring via Spark UDF.

What are the prerequisites?

Databricks CLI v0.294.0 or later, authenticated access to a Databricks cluster via CLI, and the parent skill databricks-core for basic operations. Training runs as a serverless job on the cluster, not locally.

Similar skills

All skills for AI and ML →

From the same set30

The whole set →
databricks-apps-python databricks-apps-python — a skill for Claude Code, Codex, Cursor and other agents that adds Python backend support for Databricks Apps. CX Codex +1 363installs databricks-execution-compute databricks-execution-compute is a skill that runs code on Databricks and helps choose a compute mode for Spark scripts, longer jobs, and interactive clusters. CX Codex +1 359installs databricks-python-sdk Guidance for building with the Databricks Python SDK, Connect, CLI, and REST API. Use it when your code needs to work with Databricks services. CX Codex +1 358installs databricks-mlflow-evaluation databricks-mlflow-evaluation — a skill for running mlflow.genai.evaluate(), building scorers and datasets, aligning judges with MemAlign, and watching production quality on Databricks. CX Codex +1 355installs databricks-lakeflow-connect databricks-lakeflow-connect — a skill for Claude Code builds and debugs Lakeflow Connect ingestion from SQL Server, PostgreSQL, MySQL, and Oracle into Unity Catalog. It covers CDC and query-based loads. CX Codex +1 348installs databricks-zerobus-ingest The databricks-zerobus-ingest skill helps route events, logs, CDC, and telemetry into Databricks Delta tables. It fits streaming setups that do not need a separate broker. CX Codex +1 331installs databricks-unstructured-pdf-generation databricks-unstructured-pdf-generation creates synthetic PDF files and paired evaluation questions locally, then copies them to Databricks Unity Catalog volumes for RAG testing. CX Codex +1 328installs databricks-iceberg databricks-iceberg — a skill for creating and managing Apache Iceberg tables on Databricks, syncing Delta with Iceberg via UniForm, and exposing tables to external engines through REST Catalog. CX Codex +1 327installs

Project sponsors

Companies that keep this analytics open