sphereface-plus
sphereface-plus copied to clipboard
Effect of mean and scale on the sphereface-plus training
Hello, Thanks for the great work. One thing I noticed is that if I change the default mean and scale value, the softmax loss overflows (in sphereface training) and model does not converge without overflowing (in sphereface-plus). The problem is that I can not use this 127.5 and 0.0078125 as the scale value somehow. Could you please suggest, how to use mean value as 127 and scale as 1.0 (any layers should I change or any parameters should I modify) and still make the model convergent?
transform_param {
mean_value: 127.5
mean_value: 127.5
mean_value: 127.5
scale: 0.0078125
mirror: true
}