Philipp Sodmann

I am getting NaN Losses with the learned positional embeddings, when turning it off, the loss is fine. It seems using half precision is the issue, when replacing fp16 with...

Does it happen always or only using leds?