mem0 icon indicating copy to clipboard operation
mem0 copied to clipboard

Support LLMs from vllm

Open xxm1668 opened this issue 2 years ago • 1 comments

Add support for loading LLM models from vllm package: https://github.com/vllm-project/vllm

xxm1668 avatar Dec 19 '23 02:12 xxm1668

Hey @xxm1668, we don't yet have support for models from vllm but it should be easy to add. We can prioritize it for you.

deshraj avatar Dec 19 '23 04:12 deshraj