gradnorm-pytorch icon indicating copy to clipboard operation
gradnorm-pytorch copied to clipboard

Differences with encodec loss balancer

Open BakerBunker opened this issue 1 year ago • 0 comments

What is the difference between GradNorm paper and Encodec loss balancer? A recent NVIDIA paper approved the effectiveness of encodec loss balancer in section 4.4.5.

And could this library directly return a balanced loss, it will be easier to use.

BakerBunker avatar Feb 23 '24 06:02 BakerBunker