# Pipeline parallelism

Assigns consecutive groups of layers to different devices and streams micro-batches through them.

## What it is used for

Fitting very deep models across many devices.