text-generation-webui
text-generation-webui copied to clipboard
Since some update min_token_length or minimum length has disapeared
Describe the bug
There used to be a parameter for minimum generated tokens, some models I have are simply just unusable without this parameter available please add it back!
Is there an existing issue for this?
- [X] I have searched the existing issues
Reproduction
Go to parameters and look for min token length it is not there.
Screenshot
No response
Logs
N/A
System Info
3070, windows 10
I think it only worked with beam search? I know id didn't work with normal sampling. I do remember it being removed.
yeah it was fun if you had a lot of memory to set it to like 10,000 new tokens and it would write really long paragraphs now its a laughable and small paragraph