text-generation-webui icon indicating copy to clipboard operation
text-generation-webui copied to clipboard

Since some update min_token_length or minimum length has disapeared

Open iboyles opened this issue 1 year ago • 2 comments

Describe the bug

There used to be a parameter for minimum generated tokens, some models I have are simply just unusable without this parameter available please add it back!

Is there an existing issue for this?

  • [X] I have searched the existing issues

Reproduction

Go to parameters and look for min token length it is not there.

Screenshot

No response

Logs

N/A

System Info

3070, windows 10

iboyles avatar May 08 '24 19:05 iboyles

I think it only worked with beam search? I know id didn't work with normal sampling. I do remember it being removed.

Ph0rk0z avatar May 08 '24 21:05 Ph0rk0z

yeah it was fun if you had a lot of memory to set it to like 10,000 new tokens and it would write really long paragraphs now its a laughable and small paragraph

Tom-Neverwinter avatar May 08 '24 23:05 Tom-Neverwinter