composer icon indicating copy to clipboard operation
composer copied to clipboard

Update docstring for get_model_state_dict

Open eracah opened this issue 1 year ago • 0 comments
trafficstars

Turns out it's empty dict for nonzero ranks for unsharded state dicts because for torch 2.1.2 we set the FullStateDictConfig rank0_only flag to True and for torch >2.1.2, the dcp.get_model_state_dict function always has empty dict for nonzero ranks for unsharded state dicts

eracah avatar May 23 '24 22:05 eracah