Ranger-Deep-Learning-Optimizer icon indicating copy to clipboard operation
Ranger-Deep-Learning-Optimizer copied to clipboard

Published 20 hours ago • verified publisher icon lessw2020

Ranger and pytorch DDP

Open hadaev8 opened this issue 5 years ago • 0 comments

I tried ranger vs adamw on single and 8 gpu setup, while ranger better on single gpu, on DDP setup it performe worse, any advises?

hadaev8 avatar Dec 09 '19 15:12 hadaev8