DeepSpeedExamples
DeepSpeedExamples copied to clipboard
Invalidate trace cache @ step 0: expected module 0, but got module 6
Hi, when I use zero3 to train model, but occurs Invalidate trace cache @ step 0: expected module 0, but got module 6
, anyone who knows the reason.