SphereFace icon indicating copy to clipboard operation
SphereFace copied to clipboard

what is the meaning of ff, f, l ?

Open qiyang77 opened this issue 6 years ago • 3 comments

hello, I am a bit of confuse about reading this code about calculating A-softloss

qiyang77 avatar Apr 16 '19 02:04 qiyang77

you'd better refer the Large-Margin Softmax Loss for Convolutional Neural network, which explains the lambda's meanings.

sycophant-stone avatar Apr 25 '19 14:04 sycophant-stone

but, here,the code. l, f, ff is constant.which isn't right. l = 0. f = 1.0/(1.0+l) ff = 1.0 - f

the l should depends at the global_steps.

sycophant-stone avatar Apr 25 '19 14:04 sycophant-stone

Hello, I change the "l" crosspond to the training step, and let angular-softmax with a very small part at beginning and about 0.1 ratio at the end. however, it seems strange, the loss decrease normally at beginning and start increase at some training step, with a-softmax increase. and the acc decrease too, have anyone meet this problem? If anyone have some trick about the raito decay? ps: I have fixed the code to avoid gradient explosion problem.

jsdtwry avatar Nov 04 '19 15:11 jsdtwry