databricks-ml-training — Claude Code skill
databricks-ml-training is a skill for training classifiers and regressors on Databricks with XGBoost, scikit-learn, LightGBM, or PyTorch, and tracking runs with MLflow.
no license 354 installs ★ 408 updated 2026-10-24
npx skills add databricks/databricks-agent-skills --skill databricks-ml-training -a claude-codeWhat databricks-ml-training does
This skill runs model training directly on a Databricks cluster instead of in the local Python process where your agent runs. Build classifiers and regressors with XGBoost, scikit-learn, LightGBM, or PyTorch, with MLflow tracking every run, parameter, and artifact. Models register to Unity Catalog and can then be scored in batch via Spark UDF or served real-time through databricks-model-serving.
Inside: hyperparameter search via Optuna, model versioning with movable aliases (@prod, @challenger), feature engineering backed by UC feature tables, point-in-time joins, materialized features, and streaming Kafka features. Custom PyFunc models are also supported. Requires Databricks CLI v0.294.0+. Training must always run as a serverless job on the cluster, never locally.
Do not use for endpoint management (databricks-model-serving) or MLflow-based model evaluation (databricks-mlflow-evaluation) — each has its own skill.
What it helps with
- train a classifier on Databricks tables with hyperparameter tuning
- register a model to Unity Catalog and swap production version via alias
- score all rows in a Delta table using a registered model as a Spark UDF
- build a feature pipeline with point-in-time joins and online store
- log training runs to MLflow with automatic code snapshot and metrics
Example prompts for the agent
- Train an XGBoost classifier on
silver_turbine_featuresusing Optuna hyperparameter search and register it to UC - Score the best model
ai_demo_gen.wind_farm.turbine_failure@prodon all new records and write results togold_predictions - Create a feature view with rolling window aggregations and apply it during training with feature store backtracking
How to install databricks-ml-training
1Skills CLI (Vercel)
npx skills add databricks/databricks-agent-skills --skill databricks-ml-training -a claude-code2Manually: put the files in place
~/.claude/skills/databricks-ml-training/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/databricks-ml-training/
1Skills CLI (Vercel)
npx skills add databricks/databricks-agent-skills --skill databricks-ml-training -a codex2Manually: put the files in place
.agents/skills/databricks-ml-training/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add databricks/databricks-agent-skills --skill databricks-ml-training -a cursor2Manually: put the files in place
.cursor/skills/databricks-ml-training/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install databricks/databricks-agent-skills skills/databricks-ml-training2Manually: put the files in place
.github/skills/databricks-ml-training/SKILL.md1Skills CLI (Vercel)
npx skills add databricks/databricks-agent-skills --skill databricks-ml-training -a gemini-cli2Platform CLI
gemini skills install https://github.com/databricks/databricks-agent-skills --path skills/databricks-ml-trainingManually: put the files in place
.devin/skills/databricks-ml-training/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add databricks/databricks-agent-skills --skill databricks-ml-training -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about databricks-ml-training
How do I install databricks-ml-training in Claude Code?
Run npx skills add databricks/databricks-agent-skills --skill databricks-ml-training -a claude-code, then read the instructions in ~/.claude/skills/databricks-ml-training/SKILL.md.
What does databricks-ml-training do?
It trains ML models on a Databricks cluster with MLflow and Unity Catalog integration. Supports XGBoost, scikit-learn, LightGBM, PyTorch, Optuna hyperparameter optimization, and batch scoring via Spark UDF.
What are the prerequisites?
Databricks CLI v0.294.0 or later, authenticated access to a Databricks cluster via CLI, and the parent skill databricks-core for basic operations. Training runs as a serverless job on the cluster, not locally.