merveeozbayy

Results 1 issues of merveeozbayy

Is there a way to prevent llama2 from truncating the answer at the middle of sentence when it reaches the maximum token length?

8 comment

Hello all, I'm using llama2 7b chat huggingface model and I want to restrict the output token size to a specific value such as 512. While initializing the model I...

question