gorilla
gorilla copied to clipboard
How to add a model that is not in vllm
Hi,
I am evaluating a new model which is not in vllm. How can I generate responses with this model since I find vllm is the only way for generate()?
Thank you!