DSFD.pytorch icon indicating copy to clipboard operation
DSFD.pytorch copied to clipboard

Published 20 hours ago • verified publisher icon yxlijun

显存小的GPU跑起来很容易梯度爆炸

Open mafamily2496 opened this issue 5 years ago • 4 comments

救救只有4G显存的用户吧。。。batch_size只能设成2，跑起来动不动就梯度爆炸。。。该怎么办

mafamily2496 avatar May 26 '19 05:05 mafamily2496

把batchnorm改成groupnorm有用么

mafamily2496 avatar May 26 '19 05:05 mafamily2496

我也是

121649982 avatar Jan 17 '20 04:01 121649982

不是显存的问题，我昨天刚跑的，24G显存，batch是16，loss依然会inf

njustymk avatar Dec 18 '20 02:12 njustymk

lr调小一些应该会好点

njustymk avatar Dec 18 '20 02:12 njustymk