Skip to main content
affpapa.org
RU EN
skill

distributed-training-pytorch-fsdp — Claude Code skill: install

This skill guides PyTorch FSDP work, from parameter sharding to mixed precision and CPU offload. Use it when building or debugging distributed training code.

Install into Claude Code · claude-code-templates All methods and platforms ↓ 
npx claude-code-templates@latest --skill ai-research/distributed-training-pytorch-fsdp
Open on GitHub

What distributed-training-pytorch-fsdp does

The skill covers PyTorch FSDP concepts and implementation work, including parameter sharding, mixed-precision training, CPU offloading, and FSDP2. It is aimed at questions about the API, setup decisions, and debugging distributed training code.

Its reference material also includes torch.distributed and the Join context for workers that process different amounts of input. Joinable and JoinHook show how custom hooks can keep collective operations aligned when one process finishes early. The listed dependencies are torch>=2.0 and transformers, so a project using an older PyTorch release does not meet the stated requirement.

What it helps with

  • configure parameter sharding with PyTorch FSDP
  • choose a mixed-precision setup
  • move a training design to FSDP2
  • handle uneven input counts across workers
  • debug code built on torch.distributed

Example prompts for the agent

  • Explain how to set up parameter sharding and mixed precision with PyTorch FSDP.
  • Show how to use Join when workers receive different numbers of inputs.
  • Review this torch.distributed training code and suggest a fix for the error.

How to install distributed-training-pytorch-fsdp

1claude-code-templates

npx claude-code-templates@latest --skill ai-research/distributed-training-pytorch-fsdp

2Skills CLI (Vercel)

npx skills add davila7/claude-code-templates --skill distributed-training-pytorch-fsdp -a claude-code

3Manually: put the files in place

~/.claude/skills/distributed-training-pytorch-fsdp/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/distributed-training-pytorch-fsdp/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about distributed-training-pytorch-fsdp

How do I install distributed-training-pytorch-fsdp in Claude Code?

Run npx claude-code-templates@latest --skill ai-research/distributed-training-pytorch-fsdp.

What does distributed-training-pytorch-fsdp do?

It provides guidance for PyTorch FSDP, including parameter sharding, mixed precision, CPU offload, and FSDP2. It also covers API questions and debugging for distributed training.

What does distributed-training-pytorch-fsdp require?

The listed dependencies are torch>=2.0 and transformers. A PyTorch version below 2.0 does not satisfy the skill’s requirement.

Similar skills

All skills for AI and ML →
skill-creator official anthropics Creates and refines skills, then tests them with prompts, evaluations, and performance checks. 414,180installs writing-for-agents Matt Pocock Guidance for writing skills and agent-facing documents. Use it when editing AGENTS.md, CLAUDE.md, or reference files reached from them. 466,719installs media-use heygen-com Finds or generates media for HyperFrames videos, including voiceovers, music, cutouts, and color grades. Stores files locally in assets. CX Codex +1 1,100,000installs mcp-builder official anthropics This skill walks through building an MCP server in TypeScript or Python, from reading the protocol spec to writing tests and evaluation questions. 130,949installs subagent-driven-development Jesse Vincent This skill runs an implementation plan through fresh subagents for independent tasks and reviews each result. Use it for multi-step work in one session. CX Codex 237,746installs orchestration stablyai Coordinates supervised Orca workers with task DAGs, decision gates, and threaded messages. Fits workflows that split work across multiple agents. CX Codex +1 350,300installs

From the same set495

The whole set →
discord-bot-architect Gives your agent working patterns for Discord bots in JavaScript and Python: slash commands, buttons, menus, sharding. Useful once a bot outgrows a toy example. 106installs emerging-techniques-knowledge-distillation This skill outlines ways to transfer a large model’s outputs or probability signals to a smaller student. Use it when planning a distillation training workflow. 106installs django-pro Get Django guidance for project structure, ORM queries, APIs, tests, and deployment. Useful when building or maintaining apps with Django 5.x and its surrounding tools. 103installs deployment-procedures This skill guides production releases, post-deploy checks, and rollback choices. Use it when a project needs a platform-specific deployment plan. 101installs move-code-quality Checks Move packages against the Move Book code quality checklist and flags what breaks Move 2024 Edition rules. 100installs doc A skill for reading, creating and editing .docx files when layout matters — tables, page breaks, fonts. Useful when the document goes to a client. 99installs electron-development A Claude skill for building Electron desktop apps: context isolation, safe IPC through preload, electron-builder packaging and auto-update. 98installs statsmodels A skill for regressions, GLM, time series and hypothesis tests inside Claude. Useful when you need inference on coefficients, not just predictions. 97installs

Project sponsors

Companies that keep this analytics open
Gold sponsor
Nutra.Club

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor