gradnorm-pytorch icon indicating copy to clipboard operation
gradnorm-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains

How to properly set grad_norm_parameters ?

Open ekurtulus opened this issue 1 year ago • 0 comments

Let's assume that I have a single image feature extractor on top of which there are two linear classification heads. What should I set grad_norm_parameters in this case ? Is it the entire network?

ekurtulus avatar Dec 25 '23 20:12 ekurtulus