cursor icon indicating copy to clipboard operation
cursor copied to clipboard

Connect Cursor to a local hosted LLM on VLLM etc

Open PaulConyngham opened this issue 2 years ago • 2 comments

Describe the solution you'd like

I would like to connect cursor to a local hosted quantised LLM running on VLLM or the like. VLLM and similar projects all support an OpenAI like API with chat completions. Should be reasonable easy to implement. At the moment you are only ably to point to an Azure OpenAi endpoint. Go one step further here and allow us to point to any Chat Completions like API eg "http://localhost:1234/v1"

PaulConyngham avatar Aug 18 '23 01:08 PaulConyngham

I noticed that the issue is probably when using http not https

FarisHijazi avatar Sep 12 '23 02:09 FarisHijazi

+1 for vLLM support

eldarkurtic avatar Sep 03 '24 20:09 eldarkurtic