DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

configuration of zero stage scope in Autotuning

Open MrZhengXin opened this issue 1 year ago • 0 comments

https://github.com/microsoft/DeepSpeed/blob/4e886f0568832d292183926bcc1a9105def25f2c/deepspeed/autotuning/autotuner.py#L433-L434

But this cannot keep the user's configuration of zero stage scope. Shall Line 434 be deleted? https://github.com/microsoft/DeepSpeed/pull/3473 Or are there other concerns?

MrZhengXin avatar May 06 '23 13:05 MrZhengXin