Epoch 00001: val_loss did not improve from inf
I tried training through the following command but failed : sudo python3 ./train.py --input data/imdb_db.mat --nb_epochs 10 --depth 10. Every epoch went on with message "Epoch 000XX: val_loss did not improve from inf". Also after train.py was done, I tried plotting by "sudo python3 ./plot.history.py" but it also failed with a message "File models/history_16_8.h5 does not exist". I wonder if it's because I'm missing something.
During training, the value of loss become nan. I can't find how to solve this problem.
How did you create data/imdb_db.ma?
Try different learning rate lr.
I created data/imdb_db.mat and tried lr 0.6, 0.8, 1.5. But the nan loss problem still occur. :(
Is this a problem with tensorflow or keras?
I want to know if there's solution from it? I have the same problem here.
In my case, the default was too high. There was some improvement when I set the weight 0.005~0.01. Sorry for my poor English and I wish you get the result you wanted. -----Original Message----- From: "Shao Hsuan Huang"[email protected] To: "yu4u/age-gender-estimation"[email protected]; Cc: "yimjunhyuck2"[email protected]; "Author"[email protected]; Sent: 2020-08-25 (화) 17:35:21 (GMT+09:00) Subject: Re: [yu4u/age-gender-estimation] Epoch 00001: val_loss did not improve from inf (#97)
I want to know if there's solution from it? I have the same problem here. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.
Thank for your suggestion. It seems that decreasing the learning rate lower than 0.01, and the loss would be improved (not NaN)?