DenseNAS icon indicating copy to clipboard operation
DenseNAS copied to clipboard

no random noise in gumbelsoftmax?

Open bysowhat opened this issue 3 years ago • 1 comments

hello: do you use gumbelsoftmax? i wonder why don't you add random noise in gumbelsoftmax and the temperature doesn't change in whole training process? thanks

bysowhat avatar May 17 '21 13:05 bysowhat

Hi! We don't use Gumble Softmax. The temperature is only used in the ResNet search space, i.e., 0.9, to sharpen the effects of architecture parameters which helps optimization.

JaminFong avatar Jul 12 '21 06:07 JaminFong