aitextgen icon indicating copy to clipboard operation
aitextgen copied to clipboard

I always get short chunks of text

Open Astraport opened this issue 3 years ago • 4 comments

When generating, I always get short chunks of text. 50 to 100 characters. I have tried min_length=200 but the generation process becomes infinite. What do you advise? Thank you.

Astraport avatar Jan 16 '22 20:01 Astraport

I also have this issue

pickles976 avatar Mar 30 '22 16:03 pickles976

same

breadbrowser avatar Jul 15 '22 13:07 breadbrowser

whats the max_length and n_embd you trained it with. because the max_length you trained it with is the max max_length for the generation

breadbrowser avatar Jul 16 '22 15:07 breadbrowser

or just set batch size to 50

breadbrowser avatar Jul 17 '22 15:07 breadbrowser