PPLM icon indicating copy to clipboard operation
PPLM copied to clipboard

Published 20 hours ago • verified publisher icon uber-research

Inference Time

Open yijunzhouzoey opened this issue 5 years ago • 1 comments

Thanks for your brilliant work!

Currently, I am trying the PPLM with a discriminator on GPU but it still needs around 5 mins to generate 512 tokens. I wonder if there is any way to speed up the inference time?

Many thanks and best regards, Yijun

yijunzhouzoey avatar Dec 08 '20 06:12 yijunzhouzoey

Hi @EstelleZhou,

yes, you could try to speed this up by decreasing the number of iteration per token. However, this may lead to a worst result, in term of positivity/negativity, compared to the one reported in the paper.

Andrea

andreamad8 avatar Dec 28 '20 03:12 andreamad8