TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

Fix default min length

Open akhoroshev opened this issue 7 months ago • 1 comments

When passing 1 to the minimum length I expect at least 1 NOT eof token.

But since 1 is the default value minLengths tensor is nullptr and penalty does't work.

akhoroshev avatar Jul 11 '24 13:07 akhoroshev