Skip to main content
skill CX Codex

runai-diagnose-failed-workload — Claude Code skill

runai-diagnose-failed-workload diagnoses crashed, stopped, OOMKilled, and startup-failed Run:ai workloads using structured evidence and read-only cluster queries.

no license ★ 4,106 updated 2026-10-23

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add NVIDIA/skills --skill runai-diagnose-failed-workload -a claude-code
Open on GitHub

What runai-diagnose-failed-workload does

The skill investigates terminated or broken Run:ai jobs, focusing on issues like CrashLoopBackOff, container startup failures, volume mount issues, and ImagePullBackOff. It gathers context from workload specifications, metrics, and pod events. The workflow remains strictly read-only: it reports findings and suggests remedies without editing, stopping, or restarting resources.

Inspection operates on two tiers. Tier 1 requires an MCP setup with read access to the Run:ai service account for specifications, events, and metrics. Tier 2 is optional, relying on read-only Kubernetes credentials to pull prior container logs, node descriptions, and namespace events via kubectl.

Every run requires an explicit cluster_id. You must provide either a direct Run:ai UUID or both the workload name and project name. Normal completions, suspended jobs, and scheduling preemption fall outside this skill's scope.

What it helps with

  • categorize terminal failures into root causes like app crashes or OOM terminations
  • inspect failed pod startups caused by invalid images or init scripts
  • trace storage issues from persistent volume claim mounts
  • separate worker node outages from application errors

Example prompts for the agent

  • Diagnose why workload w-98765 failed on cluster ai-prod-1
  • Check the CrashLoopBackOff cause for finetune-llm in project research on cluster k8s-gpu
  • Find why job eval-batch stopped in project testing on cluster dev-cluster over the last 48h

How to install runai-diagnose-failed-workload

1Skills CLI (Vercel)

npx skills add NVIDIA/skills --skill runai-diagnose-failed-workload -a claude-code

2Manually: put the files in place

~/.claude/skills/runai-diagnose-failed-workload/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/runai-diagnose-failed-workload/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about runai-diagnose-failed-workload

How to install runai-diagnose-failed-workload in Claude Code?

Run npx skills add NVIDIA/skills --skill runai-diagnose-failed-workload -a claude-code. The definition will be placed in ~/.claude/skills/runai-diagnose-failed-workload/SKILL.md.

What does runai-diagnose-failed-workload do?

It evaluates logs, pod states, and Run:ai metrics to classify why a specific job terminated or failed to start, returning a quantified verdict without modifying the cluster.

What credentials does this skill require?

It needs Tier 1 MCP read access to Run:ai workloads, specs, and metrics. Optional Tier 2 access uses read-only Kubernetes credentials for deeper container log inspection.

Similar skills

All skills for AI and ML →

From the same set312

The whole set →
doca-telemetry Skill for reading DOCA hardware counters from BlueField DPU or ConnectX NIC via doca_telemetry_pcc, doca_telemetry_dpa, doca_telemetry_diag and other per-domain libraries. CX Codex +1 ★ 4,106repo stars nvshmem-configure-nic-pe-mapping nvshmem-configure-nic-pe-mapping recommends NVSHMEM NIC-to-PE bindings and environment exports based on target node GPU and RDMA topology. CX Codex +1 ★ 4,106repo stars i4h-workflow-train-rl i4h-workflow-train-rl is a Claude Code skill for training, evaluating, and exporting RL policies for Workflow with RSL-RL or RLinf profiles. CX Codex +1 ★ 4,106repo stars doca-pipeline-language-developer-tools doca-pipeline-language-developer-tools routes an agent through the DOCA Pipeline Language debugging toolset on a BlueField DPU: DPL Nspect, DPL Debugger, DPL Admin, P4 Runtime Shell and the DPL Runtime Controller SDK. CX Codex +1 ★ 4,106repo stars doca-upgrade The doca-upgrade skill checks the installed DOCA release, reports the gap to a target, and waits for explicit approval before guiding a change. It also covers rollbacks and interrupted upgrades. CX Codex +1 ★ 4,106repo stars doca-telemetry-utils Runs doca_telemetry_utils on a host with DOCA to track where telemetry metrics disappear between exporter and collector. CX Codex +1 ★ 4,106repo stars doca-socket-relay Bridges host socket traffic onto a BlueField DPU via DOCA Socket Relay without rewriting applications. CX Codex +1 ★ 4,106repo stars nvshmem-troubleshoot-and-report-bugs nvshmem-troubleshoot-and-report-bugs uses launch details and per-PE logs to investigate NVSHMEM runtime failures and draft a bug report. Its diagnosis workflow is read-only. CX Codex +1 ★ 4,106repo stars

Project sponsors

Companies that keep this analytics open