DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard

Invalidate trace cache @ step 0: expected module 0, but got module 6

Open boundles opened this issue 1 year ago • 0 comments

Hi, when I use zero3 to train model, but occurs Invalidate trace cache @ step 0: expected module 0, but got module 6, anyone who knows the reason.

boundles avatar Dec 31 '23 14:12 boundles