blob: d4c9aaafa5b3e171d5471e4ba8fc855d470cfcea [file] [log] [blame] [view]
# Pipeline Parallelism for PyTorch
`torch.distributed.pipelining` is a package for implementing pipeline parallelism on your model.
Our documentation is available [here](https://pytorch.org/docs/main/distributed.pipelining.html).
![pipeline_diagram_web](https://github.com/pytorch/PiPPy/assets/6676466/c93e2fe7-1cd4-49a2-9fd8-231ec9905e0c)