storchastic
storchastic copied to clipboard
Implement Gumbel-Rao Monte Carlo estimator
See https://openreview.net/pdf?id=Mk6PZtgAgfq Relatively straightforward to implement: Like a reparameterization with a modified (stochastic!) backward pass override. Overriding backward pass is already needed to implement normal straight-through Gumbel softmax, so just modify it.