Skip to main content
skill CX Codex

setting-up-experiment-tracking — Claude Code skill: what it does

setting-up-experiment-tracking configures MLflow or Weights & Biases for machine learning projects, installs packages, and writes code to log parameters, metrics, and artifacts.

MIT 1 installs ★ 2,935 updated 2026-11-01

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add jeremylongshore/tons-of-skills-marketplace --skill setting-up-experiment-tracking -a claude-code
Open on GitHub

What setting-up-experiment-tracking does

The skill inspects your project context to determine whether MLflow or Weights & Biases fits best. It installs the required Python dependencies (mlflow or wandb), sets up environment variables, and prepares tracking targets.

For local setups, the agent can launch a local MLflow server. For cloud tracking, it connects your workflow to a W&B workspace. It then outputs practical code snippets to record training hyperparameters, evaluation metrics, and model artifacts.

Because the skill executes terminal commands and edits project files, it requires Bash execution permissions to install dependencies and run the tracking backend.

What it helps with

  • configure MLflow or Weights & Biases in a machine learning repo
  • generate boilerplate code for logging metrics and parameters
  • track models and datasets as experiment artifacts
  • start a local MLflow tracking server

Example prompts for the agent

  • Set up experiment tracking using MLflow for this model
  • Integrate Weights & Biases to track training metrics and artifacts
  • Initialize MLflow and show me how to log parameters

How to install setting-up-experiment-tracking

1Skills CLI (Vercel)

npx skills add jeremylongshore/tons-of-skills-marketplace --skill setting-up-experiment-tracking -a claude-code

2Manually: put the files in place

~/.claude/skills/setting-up-experiment-tracking/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/setting-up-experiment-tracking/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about setting-up-experiment-tracking

How do I install setting-up-experiment-tracking in Claude Code?

Run npx skills add jeremylongshore/tons-of-skills-marketplace --skill setting-up-experiment-tracking -a claude-code in your terminal.

What does setting-up-experiment-tracking do?

It installs MLflow or Weights & Biases, configures environment settings, and supplies code templates for logging metrics and saving artifacts.

Does this skill support cloud and local tracking?

Yes, it configures local MLflow instances for on-machine tracking and Weights & Biases for remote, collaborative project tracking.

Source text

SKILL.md · MIT
---
name: setting-up-experiment-tracking
description: 'Implement machine learning experiment tracking using MLflow or Weights
  & Biases. Configures environment and provides code for logging parameters, metrics,
  and artifacts. Use when asked to "setup experiment tracking" or "initialize MLflow".
  Trigger with relevant phrases based on skill purpose.

  '
allowed-tools: Read, Write, Edit, Grep, Glob, Bash(cmd:*)
version: 1.19.0
author: Jeremy Longshore <[email protected]>
license: MIT
tags:
- ai
- ml
- logging
compatibility: Designed for Claude Code
---
# Experiment Tracking Setup

Configure ML experiment tracking with MLflow or Weights & Biases, including environment setup and code for logging parameters, metrics, and artifacts.

## Overview

This skill streamlines the process of setting up experiment tracking for machine learning projects. It automates environment configuration, tool initialization, and provides code examples to get you started quickly.

## How It Works

1. **Analyze Context**: The skill analyzes the current project context to determine the appropriate experiment tracking tool (MLflow or W&B) based on user preference or existing project configuration.
2. **Configure Environment**: It configures the environment by installing necessary Python packages and setting environment variables.
3. **Initialize Tracking**: The skill initializes the chosen tracking tool, potentially starting a local MLflow server or connecting to a W&B project.
4. **Provide Code Snippets**: It provides code snippets demonstrating how to log experiment parameters, metrics, and artifacts within your ML code.

## When to Use This Skill

This skill activates when you need to:

- Start tracking machine learning experiments in a new project.
- Integrate experiment tracking into an existing ML project.
- Quickly set up MLflow or Weights & Biases for experiment management.
- Automate the process of logging parameters, metrics, and artifacts.

## Examples

### Example 1: Starting a New Project with MLflow

User request: "track experiments using mlflow"

The skill will:

1. Install the `mlflow` Python package.
2. Generate example code for logging parameters, metrics, and artifacts to an MLflow server.

### Example 2: Integrating W&B into an Existing Project

User request: "setup experiment tracking with wandb"

The skill will:

1. Install the `wandb` Python package.
2. Generate example code for initializing W&B and logging experiment data.

## Best Practices

- **Tool Selection**: Consider the scale and complexity of your project when choosing between MLflow and W&B. MLflow is well-suited for local tracking, while W&B offers cloud-based collaboration and advanced features.
- **Consistent Logging**: Establish a consistent logging strategy for parameters, metrics, and artifacts to ensure comparability across experiments.
- **Artifact Management**: Utilize artifact logging to track models, datasets, and other relevant files associated with each experiment.

## Integration

This skill can be used in conjunction with other skills that generate or modify machine learning code, such as skills for model training or data preprocessing. It ensures that all experiments are properly tracked and documented.

## Prerequisites

- Appropriate file access permissions
- Required dependencies installed

## Instructions

1. Invoke this skill when the trigger conditions are met
2. Provide necessary context and parameters
3. Review the generated output
4. Apply modifications as needed

## Output

The skill produces structured output relevant to the task.

## Error Handling

- Invalid input: Prompts for correction
- Missing dependencies: Lists required components
- Permission errors: Suggests remediation steps

## Resources

- Project documentation
- Related skills and commands

© Jeremy Longshore · MIT · jeremylongshore/tons-of-skills-marketplace

Similar skills

All skills for AI and ML →

From the same set139

The whole set →
firecrawl-cost-tuning firecrawl-cost-tuning traces where Firecrawl credits go and trims the bill through endpoint choice, format discipline, cache policy and spend limits, checked against quality. CX Codex +1 1installs retellai-cost-tuning retellai-cost-tuning optimizes voice agent and telephony expenses on Retell AI. Helps trim phone call budgets while preserving essential human-handoff triggers. CX Codex +1 1installs groq-cost-tuning groq-cost-tuning — a skill for reducing Groq API costs through model routing, token minimization, and usage tracking. CX Codex +1 1installs exa-cost-tuning Skill to control Exa API costs through endpoint selection, result limits, per-key budgets, and response cost tracking. Triggers on "Exa cost tuning", "review Exa cost tuning", or "fix Exa cost tuning". CX Codex +1 1installs openrouter-streaming-setup openrouter-streaming-setup — a skill for Claude Code, Codex, Cursor and other platforms that implements streaming responses from OpenRouter via Server-Sent Events. CX Codex +1 1installs evernote-core-workflow-a evernote-core-workflow-a — a skill for Claude Code and five other platforms that covers the primary Evernote workflow: note creation, notebook organisation, and tag management. Handles CRUD operations, ENML formatting, and notebook stacks. CX Codex +1 1installs backlog-grooming-assistant backlog-grooming-assistant automates backlog grooming workflows, guides task refinement, and validates project management configurations. CX Codex +1 1installs long-polling-handler An auto-activating skill for long polling handler work in API integrations, with step-by-step guidance, generated code and configuration checks. CX Codex +1 1installs

Project sponsors

Companies that keep this analytics open