lightning-thunder icon indicating copy to clipboard operation
lightning-thunder copied to clipboard

Published 20 hours ago • verified publisher icon Lightning-AI

`state_dict` transform for `fsdp(jit(model))`

Open crcrpar opened this issue 1 year ago • 0 comments

What does this PR do?

Transform for fsdp(jit(model)).state_dict() by all-gathering and unpadding params

crcrpar avatar Aug 02 '24 06:08 crcrpar