XLnet-gen icon indicating copy to clipboard operation
XLnet-gen copied to clipboard

Collab notebook results VS samples?

Open zacharymacleod opened this issue 4 years ago • 1 comments

So I've tried using the collab notebook for conditional generation, but the results are nowhere near as long or as good quality as the samples listed in the Medium article. They seem to lose coherency very quickly and start repeating phrases or single words repeatedly. What were the arguments used to create the samples?

zacharymacleod avatar Jul 18 '19 16:07 zacharymacleod

The samples shown are generated using --bidirectional_eachstep flag. I updated the repository recently so that the flag wasn't true by default. This was done to reduce the inference time. However, the quality suffers after a sentence or two.

rusiaaman avatar Jul 20 '19 13:07 rusiaaman