gradnorm-pytorch
gradnorm-pytorch copied to clipboard
Differences with encodec loss balancer
What is the difference between GradNorm paper and Encodec loss balancer? A recent NVIDIA paper approved the effectiveness of encodec loss balancer in section 4.4.5.
And could this library directly return a balanced loss, it will be easier to use.