pytorch-lightning icon indicating copy to clipboard operation
pytorch-lightning copied to clipboard

Published 20 hours ago • verified publisher icon Lightning-AI

why does lightning still not support Pipeline parallelism?

Open marsggbo opened this issue 2 years ago • 3 comments
trafficstars

Description & Motivation

I want to benchmark different parallelisms, but I didn't find pipeline mode.

Pitch

No response

Alternatives

No response

Additional context

No response

cc @borda

marsggbo avatar Mar 23 '23 14:03 marsggbo

+1. Does lightning has the plan to support pipeline parallelism?

xin-w8023 avatar Apr 14 '23 08:04 xin-w8023

Still waiting for the PP in Lightning. The good news is that PyTorch is going to make PP an official feature in the future. See Pipeline Parallelism.

leonardodalinky avatar Aug 25 '24 08:08 leonardodalinky

+1 on this!

olly-writes-code avatar Oct 12 '24 04:10 olly-writes-code