storchastic
storchastic copied to clipboard
Implement VIMCO and OVIS
Importance Weighted autoencoder bounds (IWAE) are easily implemented using Storchastic, but don't work out of the box: Using the score function with batch average on the ELBO is not the same as VIMCO, for example, as it reduces the samples somewhat differently. Maybe it is possible to create a general VI API that allows automatically choosing between ELBO and VIMCO depending on the estimator used.
One way this could be implemented is by using a different objective, ie a storch function that automatically reduces the correct plate.