limt1

CUDA out of memory OR gradient overflow with fp16

1

Hi all, I am either getting CUDA out of memory or gradient overflow when I enable the the fp16 option. The train runs normally without the "fp16". Any ideas? Here...