heechanlee

Results 1 comments of heechanlee

why upscaling weight by 1/1-p after concrete dropout

https://github.com/yaringal/ConcreteDropout/issues/1#issuecomment-337313695 From the comment above, I guess it is for making mean of weights after dropout be W. Is there any reference why we should do that?