# DeepSpeed ZeRO

A set of memory optimizations that partition training state across devices so much larger models fit.

## What it is used for

Training and fine-tuning models that do not fit on one GPU.