JetStream icon indicating copy to clipboard operation
JetStream copied to clipboard

Published 20 hours ago • verified publisher icon google

Support completions API

Open nstogner opened this issue 5 months ago • 0 comments

Supporting openai-api-compatible endpoints like the /v1/chat/completions and /v1/completions APIs would have the following benefits:

  • Allow Jetstream to be used as a drop-in replacement for the vLLM server
  • Make it easier to demo Jetstream with OSS chat UIs (i.e. https://github.com/open-webui/open-webui, https://github.com/danny-avila/LibreChat, etc)

nstogner avatar Sep 05 '24 15:09 nstogner