DialogVED icon indicating copy to clipboard operation
DialogVED copied to clipboard

Question about K-L term objective

Open ZZdozeoff opened this issue 1 year ago • 1 comments

Thanks for your contribution, this novel VED form pretrained dialog model is very helpful ! After reading your reasearch, I have a question about K-L regularization term. Most variational generation in dialog models use CVAE objective, they have prior and posterior network and use K-L term $KL (q(z|c,r) || p(z|c) )$ But in your work, this posterior $q(z|c,r)$ is replaced by $q(z)$. May I ask why do you use this replacement ?

ZZdozeoff avatar Oct 12 '22 08:10 ZZdozeoff