aitextgen icon indicating copy to clipboard operation
aitextgen copied to clipboard

Published 20 hours ago • verified publisher icon minimaxir

Glitchy initial generations (missing text, weird punctuation)

Open minimaxir opened this issue 4 years ago • 1 comments

The initial generations of some texts tend to have missing text, weird punctuation not present in the original dataset. This could be a function of tokenization.

Although the generation changes in 0.5.0 mitigate this, I should probably verify it's not another tokenization issue that could cause breakage.

minimaxir avatar Apr 19 '21 16:04 minimaxir

Possibly fixed by https://github.com/minimaxir/aitextgen/commit/62dce28249dd019a4be61ce94961fd4597403562 as recent generations were not correctly reading the "beginning."

minimaxir avatar May 01 '21 19:05 minimaxir