irgan icon indicating copy to clipboard operation
irgan copied to clipboard

Importance Sampling in Generator

Open cdgiv opened this issue 6 years ago • 2 comments

Can you elaborate on this part of the code? https://github.com/geek-ai/irgan/blob/master/ltr-gan/ltr-gan-pointwise/ltr_gan_d_nn_g_nn.py#L125-L129

I am trying to understand where the importance sampling came from - I do not see it mentioned anywhere in the papers for IRGAN, REINFORCE, GANs, RankNet, etc.

Is this just from Monte Carlo sampling? If so, can you provide a good reference?

Thanks!

cdgiv avatar Jun 28 '18 18:06 cdgiv

I also have this question

SongFGH avatar Nov 11 '18 03:11 SongFGH

It's a trick widely used in RL. You can search for the keyword: off-policy, importance sampling. Hope it can help you!

huangtinglin avatar Apr 01 '20 01:04 huangtinglin