flows_ood icon indicating copy to clipboard operation
flows_ood copied to clipboard

Published 20 hours ago • verified publisher icon PolinaKirichenko

Is SyncBN Used?

Open GloryyrolG opened this issue 3 years ago • 1 comments

Hi Polina,

Thanks for your excellent code. May I know whether SyncBN is used in the mode of multiple GPUs?

See the reference: https://github.com/PolinaKirichenko/flows_ood/blob/e9755db3454bbf9e8d46086446ddb9caa8870173/flow_ssl/invertible/normalizations.py#L13

Thx & Regards,

Glory

GloryyrolG avatar May 16 '21 09:05 GloryyrolG

Since actnorm is adopted in Glow, it is more about whether actnorm is synchronous or not?

GloryyrolG avatar May 16 '21 14:05 GloryyrolG