Skip to main content
affpapa.org
RU EN
skill

distributed-training-accelerate — Claude Code skill

This skill shows how to adapt PyTorch training code for HuggingFace Accelerate. Use it to move from one GPU to distributed runs or configure mixed precision.

Install into Claude Code · claude-code-templates All methods and platforms ↓ 
npx claude-code-templates@latest --skill ai-research/distributed-training-accelerate
Open on GitHub

What distributed-training-accelerate does

The skill walks through adding Accelerator to a PyTorch script, preparing the model, optimizer, and dataloader, then routing backpropagation through Accelerate. The same training code can be configured for DDP, DeepSpeed, FSDP, or Megatron and started with accelerate launch train.py.

Its examples cover the interactive accelerate config flow, FP16 and BF16, ZeRO-2, FSDP, and gradient accumulation. The installation instructions use pip install accelerate; torch and transformers are also listed as dependencies. The FP8 example targets H100 and later hardware, so check that requirement before choosing that mode.

What it helps with

  • adapt a single-GPU PyTorch script for multi-GPU training
  • configure training with DDP, DeepSpeed, or FSDP
  • enable FP16 or BF16 for a training run
  • accumulate gradients across batches

Example prompts for the agent

  • Show me how to add Accelerate to my PyTorch training script.
  • Configure train.py to run across multiple GPUs with DeepSpeed ZeRO-2.
  • Add gradient accumulation and BF16 mixed precision to this training loop.

How to install distributed-training-accelerate

1claude-code-templates

npx claude-code-templates@latest --skill ai-research/distributed-training-accelerate

2Skills CLI (Vercel)

npx skills add davila7/claude-code-templates --skill distributed-training-accelerate -a claude-code

3Manually: put the files in place

~/.claude/skills/distributed-training-accelerate/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/distributed-training-accelerate/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about distributed-training-accelerate

How do I install distributed-training-accelerate in Claude Code?

Run npx claude-code-templates@latest --skill ai-research/distributed-training-accelerate.

What does distributed-training-accelerate do?

It guides you through using HuggingFace Accelerate with PyTorch for distributed training. The examples cover DDP, DeepSpeed, FSDP, and mixed precision.

What hardware does the FP8 example require?

The example specifies H100 or later for FP8. The installation instructions use pip install accelerate.

Similar skills

All skills for AI and ML →
skill-creator official anthropics Creates and refines skills, then tests them with prompts, evaluations, and performance checks. 414,180installs writing-for-agents Matt Pocock Guidance for writing skills and agent-facing documents. Use it when editing AGENTS.md, CLAUDE.md, or reference files reached from them. 466,719installs media-use heygen-com Finds or generates media for HyperFrames videos, including voiceovers, music, cutouts, and color grades. Stores files locally in assets. CX Codex +1 1,100,000installs mcp-builder official anthropics This skill walks through building an MCP server in TypeScript or Python, from reading the protocol spec to writing tests and evaluation questions. 130,949installs subagent-driven-development Jesse Vincent This skill runs an implementation plan through fresh subagents for independent tasks and reviews each result. Use it for multi-step work in one session. CX Codex 237,746installs orchestration stablyai Coordinates supervised Orca workers with task DAGs, decision gates, and threaded messages. Fits workflows that split work across multiple agents. CX Codex +1 350,300installs

From the same set804

The whole set →
concise-planning Turns a coding request into one plan of atomic steps. Useful when you want the scope agreed before anyone edits files. 117installs sqlmap-database-pentesting Guides database penetration testing workflows using sqlmap. Helps security professionals systematically verify injection points and inspect schemas. 116installs svelte-storybook-story Creates comprehensive Storybook stories for Svelte components using Svelte CSF and interaction tests. Helpful when documenting component libraries. 116installs publisher-devto Builds an RSS 2.0 feed from your blog posts and saves it for Dev.to imports. Use it to syndicate new articles through a feed. 116installs deep-research-notebooklm Runs multi-source research on NotebookLM and writes a structured brief to a local file, with optional slides, podcasts or reports. 115installs svelte-test-fix A Claude slash command that digs into failing Svelte and SvelteKit tests and proposes fixes. Useful right after a component change breaks your suite. 115installs wireshark-analysis A Claude skill for Wireshark work: capture and display filters, TCP/UDP stream reconstruction, protocol stats and anomaly hunting. 113installs smtp-penetration-testing A Claude skill that walks the agent through SMTP checks: banner grabbing, user enumeration, open relay tests, credential brute force. 113installs

Project sponsors

Companies that keep this analytics open
Gold sponsor
Nutra.Club

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor