Results
1
issues of
Karl.LM
Could you explain why Pipeline parallelism is not compatible with ZeRO-2 and ZeRO-3? Are there any design tradeoffs? Because as far as I know, it is pretty common to train...
enhancement