HorizonNet
HorizonNet copied to clipboard
Magic number in decoder fc layer
Hi, thanks for sharing the code, in the code of decoder bias, what is the meaning of these magic numbers? Can we randomly initialize the bias in the normal way? https://github.com/sunset1995/HorizonNet/blob/e6d7e03c4438169a5afc117c47e5314c9b914a4c/model.py#L214-L216
The intuition is to init them to their corresponding mean value. But I find this only has little affect on the final results.