pytorch-lars

pytorch-lars copied to clipboard

ZeroDivisionError when calculating local lr

1

Hi! I have come into a `ZeroDivisionError: float division by zero` error when using your LARS code, which is reported to happen at line 87 of `lars.py`. To fix this,...

KaiChen1998

ywangeq

Did you use warmup technique?

1

Thanks for your sharing. I've noticed that the generalization gap between small batch size and large batch size is not the same as described as in the original paper. I'm...

syorami