David Wu

Results 2 comments of David Wu

[enhancement - cli output] Add json output in addition to the existing text format

+1

Generate nothing from VLLM output

I get a similar output. Tested on vllm 0.4.2 and vllm 0.4.3. If I try to use Mistral 7B Instruct v0.2, it generates blanks for a particular given input. However,...