lighter
lighter copied to clipboard
Config instantiation is not DDP-aware
Because config is instantiated only on the main process and then DDP is initialized, objects that are initialized in the config are not DDP aware.
Maybe there is a way to fix this by instantiating trainer
first and separate and then the system