magi_llm_gui icon indicating copy to clipboard operation
magi_llm_gui copied to clipboard

Published 20 hours ago • verified publisher icon shinomakoi

Check this out

Open bbecausereasonss opened this issue 1 year ago • 1 comments

https://github.com/vllm-project/vllm

bbecausereasonss avatar Jun 20 '23 22:06 bbecausereasonss

Oh this looks interesting. I'll add it as a backend. Doesn't seem to support quantized models though, hopefully soon

shinomakoi avatar Jun 21 '23 00:06 shinomakoi