FaceRecognition_PyTorch icon indicating copy to clipboard operation
FaceRecognition_PyTorch copied to clipboard

Published 20 hours ago • verified publisher icon BobLiu20

With a learning rate of 0.1, loss is 'nan'. I don't kown why?

Open Hedlen opened this issue 6 years ago • 2 comments

When using your program，with a learning rate of 0.1, loss is ‘nan’, when I change the learning rate to 0.001, loss changes normally. I don't know why ? According to your documentation, lr 0.1 should be fine. I look forward to your reply. Thanks.

Hedlen avatar Jun 13 '18 03:06 Hedlen

hi. how much your label_num (class number)? I had tried 10K and 700K with lr=0.1 and everything is ok.

BobLiu20 avatar Jun 14 '18 12:06 BobLiu20

@BobLiu20 Hi, My label number is 10575, the dataset is CASIA-Webface. Thanks

Hedlen avatar Jun 19 '18 05:06 Hedlen