litellm icon indicating copy to clipboard operation
litellm copied to clipboard

Added CLOVA studio Hyperclova X API support

Open aschung01 opened this issue 1 year ago • 4 comments

This PR adds support for the Hyperclova X API of CLOVA studio.

Product page Chat completeion API docs

Even though it's still in closed beta, Hyperclova X is extensively used by Korean startups and companies, thanks to its proficiency in Korean.

aschung01 avatar Nov 20 '23 18:11 aschung01

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 27, 2023 2:38am

vercel[bot] avatar Nov 20 '23 18:11 vercel[bot]

missing:

  • exception mapping (check: exception_type())
  • streaming support (check: CustomStreamWrapper)

@aschung01 the colab you shared on discord worked for me. If you can add these missing items, i think this is good for merge.

krrishdholakia avatar Nov 23 '23 16:11 krrishdholakia

I just added exception mapping & sync/async fake streaming, and added examples on the colab. Could you check it out? @krrishdholakia

aschung01 avatar Nov 24 '23 02:11 aschung01

I've also modified model_prices_and_context_window.json because the JSON format wasn't consistent. Now the entire file follows a unified format.

aschung01 avatar Nov 27 '23 02:11 aschung01