lsoftmax-pytorch
lsoftmax-pytorch copied to clipboard
Have you ever tried to train with cifa10
I tried to train with cifar10 and set margin to 2, but got nan.
learning rate is set to 0.1.
Any idea?
@twmht Thank you for noting this. No, I have not tested this on CIFAR yet. I might have some free time this weekend to try it out. I will let you know if I had more insights about this issue and will update the repo accordingly
Well. the nan problem solved. but the training accuracy is very low.
It seems that it's hard to converge.
by the way, my network architecture is here https://github.com/kuangliu/pytorch-cifar/blob/master/models/shufflenetv2.py
Well. the nan problem solved. but the training accuracy is very low.
It seems that it's hard to converge.
by the way, my network architecture is here https://github.com/kuangliu/pytorch-cifar/blob/master/models/shufflenetv2.py
Have got the same problem as urs. Have u solved it yet?
I got a similar problem with cifar10 when m=2/3/4.The accuracy rate is only 10% which is extremely low.It seems that only one class has a very high accuracy rate, and the other nine classes are all 0%.
Mine is nan,too
I think 'reset_parameters()' can solve nan problem