mx-lsoftmax icon indicating copy to clipboard operation
mx-lsoftmax copied to clipboard

Why the directions of digits in visualization are exactly the same?

Open maxenceliu opened this issue 8 years ago • 4 comments
trafficstars

Not only in your ReadMe, but also in my training results. The directions of each digits in the visualization are exactly same. I think the directions should depend on the random initialization to some extent. So is there are something in your code which caused that?

Thx~

maxenceliu avatar Jul 17 '17 13:07 maxenceliu

hallo? Really wondering...

maxenceliu avatar Jul 19 '17 11:07 maxenceliu

oh ,got it. mxnet is different from numpy in function random. numpy use different random seed durning each run however mxnet use same seed....

maxenceliu avatar Jul 19 '17 11:07 maxenceliu

but still interesting, since during each train ,it use different m, this constraint won't change the final direction however

maxenceliu avatar Jul 19 '17 11:07 maxenceliu

margin won't change the direction. I think the weight initialization makes this.

luoyetx avatar Jul 19 '17 14:07 luoyetx