DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Fix redundant shared_params in zero_to_fp32.py

Open ShijieZZZZ opened this issue 1 year ago • 2 comments

state_dict["module"] has redundant params that were mistakenly recorded in shared_params

Related: (1) https://github.com/microsoft/DeepSpeed/issues/3291 (2) https://github.com/microsoft/DeepSpeed/pull/3295

ShijieZZZZ avatar Apr 05 '23 19:04 ShijieZZZZ

lets merge this?

mayank31398 avatar Apr 22 '23 19:04 mayank31398

@mayank31398, does this work in your testing?

tjruwase avatar Apr 24 '23 16:04 tjruwase