Alpaca-LoRA-Serve icon indicating copy to clipboard operation
Alpaca-LoRA-Serve copied to clipboard

Published 20 hours ago • verified publisher icon deep-diver

top_k and repetition_penalty

Open Qubitium opened this issue 2 years ago • 2 comments

Can top_k and repetition_penalty be added? Thanks.

Qubitium avatar Mar 22 '23 01:03 Qubitium

It works in batch mode

deep-diver avatar Mar 22 '23 02:03 deep-diver

@deep-diver top_k and repetition_penalty are not applicable for batch mode?

Qubitium avatar Mar 23 '23 02:03 Qubitium

it works now. but batch mode is deprecated for now.

deep-diver avatar Apr 20 '23 17:04 deep-diver