gpt-fast icon indicating copy to clipboard operation
gpt-fast copied to clipboard

repeat sentence and non-complete sentence in the end

Open allen-ash opened this issue 1 year ago • 0 comments

Firstly, thanks for your wonderful work. I have a question here. For production ready purpose of gpt-fast. Currently, repeat penalty or stop string and more function is not including in this repository. This will cause LLM generate repeat sentences and generate non-complete sentence in the end. Is there any plan to support these features?

allen-ash avatar Dec 21 '23 12:12 allen-ash