trained-ternary-quantization
trained-ternary-quantization copied to clipboard
HYPERPARAMETER_T is not learnt and is not a hyperparameter
Hi, it seems that HYPERPARAMETER_T
is set to a constant value of 0.15
and is never updated during backpropagation.
If that's true, I just want to mention it would be better if it was not called a hyperparameter.
If that's not the case, please let me know where/how it is being updated. Also thanks for the code. It helped me understand better what's going on.
Thanks.