DenseNAS
DenseNAS copied to clipboard
no random noise in gumbelsoftmax?
hello: do you use gumbelsoftmax? i wonder why don't you add random noise in gumbelsoftmax and the temperature doesn't change in whole training process? thanks
Hi! We don't use Gumble Softmax. The temperature is only used in the ResNet search space, i.e., 0.9, to sharpen the effects of architecture parameters which helps optimization.