SeqGAN icon indicating copy to clipboard operation
SeqGAN copied to clipboard

What is the difference between SeqGAN and LM for text generation?

Open guotong1988 opened this issue 5 years ago • 1 comments

I'm new to LeakGAN or SeqGAN or TextGAN. I know GAN is to generate text and let discriminator un-judge-able to real text and gen-text. LM(language model) is the task of predicting the next word and can also be used to generate text.

guotong1988 avatar Mar 11 '19 07:03 guotong1988

It is addressed in the paper in the introduction . Language models learnt in traditional maximum likelihood approach suffer exposure bias. Though there are techniques like scheduled sampling to overcome it, they do not address the problem at its roots. here an adversarial training beats that problems

mathav95raj avatar Nov 16 '20 18:11 mathav95raj