Skip to main content
skill CX Codex

sagemaker-mlflow — Claude Code skill: connect to SageMaker MLflow

sagemaker-mlflow connects the agent to SageMaker Managed MLflow via resource ARN (mlflow-app or mlflow-tracking-server), then hands off to other MLflow skills through MLFLOW_TRACKING_URI.

Apache-2.0 394 installs ★ 91 updated 2026-10-23

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add mlflow/skills --skill sagemaker-mlflow -a claude-code
Open on GitHub

What sagemaker-mlflow does

The skill validates three prerequisites: Python 3.10 or higher, AWS credentials (environment variables, aws configure, or IAM role), and the sagemaker-mlflow plugin — without it, calling mlflow.set_tracking_uri() with an ARN fails with UnsupportedModelRegistryStoreURIException. If no ARN is provided, the discover_arns.py script lists available resources in the current region; a cross-region ARN will not authenticate.

After exporting the ARN to MLFLOW_TRACKING_URI and region to AWS_DEFAULT_REGION, the skill runs verify_connection.py, which tests all three components and stops on the first failure with a remediation hint. The skill does not install dependencies or configure credentials — the user handles that.

AccessDenied or 403 means the principal lacks sagemaker-mlflow or sagemaker permissions on the ARN, or the region in AWS_DEFAULT_REGION does not match the resource region.

What it helps with

  • connect the agent to SageMaker Managed MLflow via ARN
  • validate Python version, AWS credentials, and sagemaker-mlflow plugin before use
  • discover available MLflow resources in the current AWS region
  • set up MLFLOW_TRACKING_URI for other MLflow skills
  • diagnose UnsupportedModelRegistryStoreURIException or AccessDenied errors

Example prompts for the agent

  • Connect the agent to SageMaker MLflow using ARN arn:aws:sagemaker:us-east-1:123456789012:mlflow-app/my-app
  • List available MLflow resources in my AWS region
  • Check if sagemaker-mlflow is installed and AWS credentials are configured

How to install sagemaker-mlflow

1Skills CLI (Vercel)

npx skills add mlflow/skills --skill sagemaker-mlflow -a claude-code

2Manually: put the files in place

~/.claude/skills/sagemaker-mlflow/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/sagemaker-mlflow/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about sagemaker-mlflow

How to install sagemaker-mlflow in Claude Code?

Run npx skills add mlflow/skills --skill sagemaker-mlflow -a claude-code, the skill will install to ~/.claude/skills/sagemaker-mlflow/SKILL.md.

What does sagemaker-mlflow skill do?

Connects the agent to SageMaker Managed MLflow via ARN, validates Python 3.10+, AWS credentials, and the sagemaker-mlflow plugin, then passes the environment to other MLflow skills through MLFLOW_TRACKING_URI.

What does sagemaker-mlflow require?

Python 3.10 or higher, the sagemaker-mlflow plugin (installed via pip install sagemaker-mlflow), configured AWS credentials, and an ARN for mlflow-app or mlflow-tracking-server in the same region as the credentials.

Source text

SKILL.md · Apache-2.0
---
name: sagemaker-mlflow
description: >
  Connect to SageMaker Managed MLflow (mlflow-app or mlflow-tracking-server ARN) as an
  MLflow backend, then hand off to the other MLflow skills. Triggers on a SageMaker MLflow
  ARN (arn:aws:sagemaker:...:mlflow-app/... or arn:aws:sagemaker:...:mlflow-tracking-server/...)
  or "SageMaker Managed MLflow".
---

# Connect to SageMaker MLflow

Connect using the `sagemaker-mlflow` plugin, an ARN tracking URI and AWS credentials.
Other MLflow skills inherit the connection through `MLFLOW_TRACKING_URI`.

Requires **Python >= 3.10** (mlflow >= 3.8). Validate and report the fix — never
auto-install the plugin or acquire credentials (mirrors the repo's Databricks pattern).

## Step 1: Preconditions
- `python --version` -> must be 3.10+. If older, STOP and tell the user.
- Confirm AWS credentials resolve (env vars, `aws configure` / SSO, or an IAM role). If
  they error (ExpiredToken / no creds), STOP and ask the user to configure them.
  (`scripts/verify_connection.py` also checks this, via boto3.)

## Step 2: Check the plugin
If missing, stop and give the user this installation command:
```bash
pip install sagemaker-mlflow
```
Required even if `MLFLOW_TRACKING_URI` is already an ARN — without it,
`mlflow.set_tracking_uri()` fails with `UnsupportedModelRegistryStoreURIException`.

## Step 3: Select the resource ARN
- **If the user already provided an ARN** (or `MLFLOW_TRACKING_URI` is set to
  `arn:aws:sagemaker:...`), use it as-is.
- **Otherwise, discover it** in the user's region:
  ```bash
  python scripts/discover_arns.py
  ```
  If exactly one is returned, use it; if several, list name/status/ARN and ask the user
  which to use. Both `mlflow-app` and `mlflow-tracking-server` ARNs work; the ARN is also
  shown on the resource's detail page in the SageMaker Studio console.

Then export it (the ARN is region-bound — a cross-region ARN will not authenticate):
```bash
export MLFLOW_TRACKING_URI="<arn>"    # mlflow-app/<id> or mlflow-tracking-server/<name>
export AWS_DEFAULT_REGION="<region>"  # AWS credentials resolved via the default chain (SigV4)
```

## Step 4: Verify
```bash
python scripts/verify_connection.py "$MLFLOW_TRACKING_URI"
```
Checks all three prerequisites (plugin / credentials / ARN connectivity) and exits
non-zero with a remediation hint on the first failure. Do not proceed until it passes.

After the connection verifies, hand off to the requested MLflow skill — it inherits the
connected environment via `MLFLOW_TRACKING_URI`.

## Troubleshooting
- `UnsupportedModelRegistryStoreURIException` — see Step 2, then repeat verification.
- `AccessDenied` / `403` — credentials are missing/expired, or the principal lacks MLflow
  permissions on the ARN. Check that credentials resolve, grant `sagemaker-mlflow` /
  `sagemaker` permissions, and confirm the ARN region matches `AWS_DEFAULT_REGION`.

© mlflow · Apache-2.0 · mlflow/skills

Similar skills

All skills for AI and ML →

From the same set17

The whole set →
retrieving-mlflow-traces retrieving-mlflow-traces fetches MLflow traces by ID or filters using CLI and Python API. Useful for hunting down failed traces or dissecting a slow run. CX Codex +1 991installs analyzing-mlflow-session analyzing-mlflow-session walks an MLflow session — the traces behind one multi-turn chat — to find which turn broke. Useful when a conversation with your agent goes sideways. CX Codex +1 966installs querying-mlflow-metrics querying-mlflow-metrics pulls aggregated trace metrics from MLflow: token usage, latency, trace counts and quality evaluations. Useful when you want experiment stats without leaving the chat. CX Codex +1 959installs mlflow-agent Routes MLflow requests to the right child skill for tracing, evaluation, debugging, or documentation. Use it when the task has no specific MLflow workflow selected. CX Codex +1 882installs fix-agent-issue fix-agent-issue — a skill that walks the agent through EXPLORE → PLAN → IMPLEMENT → VERIFY so a behavior change rests on a trace and a test, not a guess. CX Codex +1 376installs build-a-scorer build-a-scorer helps design and iterate MLflow judges and scorers for LLM apps or RAG agents. It defines atomic criteria and picks the cheapest reliable check. CX Codex +1 339installs mlflow-evaluation The mlflow-evaluation Claude Code skill configures MLflow scorers and evaluates an agent, dataset, precomputed outputs, or traces. It checks GenAI quality and inspects evaluation results. CX Codex +1 184installs mlflow-trace-analysis The mlflow-trace-analysis Claude Code skill examines MLflow traces to explain agent failures, errors, and quality issues. It handles single traces and multi-turn sessions. CX Codex +1 178installs

Project sponsors

Companies that keep this analytics open