lighter icon indicating copy to clipboard operation
lighter copied to clipboard

Config instantiation is not DDP-aware

Open surajpaib opened this issue 1 year ago • 5 comments

Because config is instantiated only on the main process and then DDP is initialized, objects that are initialized in the config are not DDP aware.

Maybe there is a way to fix this by instantiating trainer first and separate and then the system

surajpaib avatar Oct 10 '23 17:10 surajpaib