vllm icon indicating copy to clipboard operation
vllm copied to clipboard
verified publisher icon vllm-project

Add tests for models

Open WoosukKwon opened this issue 2 years ago • 0 comments

We need tests for the models we support. The tests should ensure that the outputs of our models when using greedy sampling are equivalent to those of HF models.

WoosukKwon avatar May 15 '23 00:05 WoosukKwon