distributed-training-deepspeed — Claude Code skill: what it does

What distributed-training-deepspeed does

This skill provides structured assistance for Microsoft DeepSpeed workflows. It covers ZeRO memory partitioning stages, pipeline parallelism, sparse attention, and mixed-precision formats including FP16, BF16, and FP8, along with 1-bit Adam optimization.

A central section explains the DeepNVMe subsystem. It explains how to instantiate aio_handle and gds_handle using builder classes, execute blocking writes, and coordinate non-blocking disk transfers via .wait() synchronization.

Using these workflows requires DeepSpeed 0.15.0 or newer alongside PyTorch, Accelerate, and Transformers. Without the host libaio-dev package, the core async_io operator will fail to build, which reveals itself as an error in ds_report.