lightllm icon indicating copy to clipboard operation
lightllm copied to clipboard

[BUG] stop_words

Open baisechundu opened this issue 1 year ago • 0 comments

When i try to add some stop_words for model,i found parameter stop_sequences in “lightllm/server/sampling_params.py”. There seems to be some issues with line 67: “ if stop_str_ids is not None and len(stop_str_ids) >= 1: ” ">=" here should be modified to ">". Otherwise, it will get an empty list when the len(stop_str_ids) equal 1.

baisechundu avatar Feb 02 '24 06:02 baisechundu