void icon indicating copy to clipboard operation
void copied to clipboard

Published 20 hours ago • verified publisher icon voideditor

How can I convert an OpenAI endpoint to a local VLLM endpoint?

Open ShikangPang opened this issue 5 months ago • 3 comments

I deployed the vllm model locally and tried to connect using the void extension, but I can't initiate a conversation. What should I do?

ShikangPang avatar Sep 25 '24 01:09 ShikangPang