ConcreteDropout icon indicating copy to clipboard operation
ConcreteDropout copied to clipboard

Published 20 hours ago • verified publisher icon yaringal

why upscaling weight by 1/1-p after concrete dropout

Open heechanlee opened this issue 4 years ago • 1 comments

https://github.com/yaringal/ConcreteDropout/issues/3#issuecomment-352718724

I can't find why weights are upscaled by 1/1-p after concrete dropout in the paper. Can anyone tell me why?

heechanlee avatar Nov 13 '20 10:11 heechanlee

https://github.com/yaringal/ConcreteDropout/issues/1#issuecomment-337313695

From the comment above, I guess it is for making mean of weights after dropout be W. Is there any reference why we should do that?

heechanlee avatar Nov 13 '20 10:11 heechanlee