Awesome-LLM icon indicating copy to clipboard operation
Awesome-LLM copied to clipboard

Published 20 hours ago • verified publisher icon Hannibal046

Feature request: list inference engines

Open brandon-lockaby opened this issue 1 month ago • 1 comments

You know... llama.cpp, exllama, vLLM, TGI

brandon-lockaby avatar May 09 '24 09:05 brandon-lockaby