web-traffic-forecasting
web-traffic-forecasting copied to clipboard
During training, train loss and validation loss became nan, does this matter?
When I ran cnn.py, during training, train loss and validation loss became nan after step 50, is this normal? I wonder why losses remains nan……
Me too, Do you use gpu ? I had this problem when I use CPU to train.
If you use gpu, it is 2080ti for me, then all the problems will be gone
10 step becaome nan.. using cpu~~~
change lr ,10 times smaller , work~;