LLFlow
LLFlow copied to clipboard
NaN or Inf found in input tensor.
Hello, sorry to bother you again. I recently encountered a new error in training, do you know why?
The number of wrong epoch is different each time.
I have met the same problem, too~
Hi, thanks for your interest in our work.
Maybe you could try the following work to alleviate this problem
https://arxiv.org/pdf/2212.04319.pdf
Besides, a trivial way may be that you could try to use a smaller learning rate.