lsoftmax-pytorch icon indicating copy to clipboard operation
lsoftmax-pytorch copied to clipboard

Have you ever tried to train with cifa10

Open twmht opened this issue 5 years ago • 6 comments

I tried to train with cifar10 and set margin to 2, but got nan.

learning rate is set to 0.1.

Any idea?

twmht avatar Nov 16 '18 12:11 twmht

@twmht Thank you for noting this. No, I have not tested this on CIFAR yet. I might have some free time this weekend to try it out. I will let you know if I had more insights about this issue and will update the repo accordingly

amirhfarzaneh avatar Nov 16 '18 22:11 amirhfarzaneh

Well. the nan problem solved. but the training accuracy is very low.

It seems that it's hard to converge.

by the way, my network architecture is here https://github.com/kuangliu/pytorch-cifar/blob/master/models/shufflenetv2.py

twmht avatar Nov 17 '18 03:11 twmht

Well. the nan problem solved. but the training accuracy is very low.

It seems that it's hard to converge.

by the way, my network architecture is here https://github.com/kuangliu/pytorch-cifar/blob/master/models/shufflenetv2.py

Have got the same problem as urs. Have u solved it yet?

SteveTsui avatar May 13 '19 04:05 SteveTsui

I got a similar problem with cifar10 when m=2/3/4.The accuracy rate is only 10% which is extremely low.It seems that only one class has a very high accuracy rate, and the other nine classes are all 0%.

EricWWWW avatar Dec 31 '19 03:12 EricWWWW

Mine is nan,too

shenbc avatar Apr 24 '21 12:04 shenbc

I think 'reset_parameters()' can solve nan problem

cyizhuo avatar Oct 18 '21 06:10 cyizhuo