UEHttpGPT icon indicating copy to clipboard operation
UEHttpGPT copied to clipboard
verified publisher icon lucoiso

API requests supporting local deployment of OpenAI-Compatible Server

Open Yimi81 opened this issue 2 years ago • 0 comments

Currently, there are many LLMs in the open-source community, along with several reasoning frameworks that support server deployment following the OpenAI API protocol (e.g. vLLM, api-for-open-llm, etc). API requests supporting local deployment of servers are quite useful.

Yimi81 avatar Dec 21 '23 06:12 Yimi81