llm.ts icon indicating copy to clipboard operation
llm.ts copied to clipboard

Plans for chat completions API / gpt-3.5-turbo?

Open ianmacartney opened this issue 2 years ago • 2 comments

First of all thank you for providing this in the first place, I'm curious if anyone has started working on the APIs available (like chat completions) with the newer, cheaper gpt-3.5-turbo model? Any forks you know of? I'm less interested in the completion api. I'm guessing it's less useful if it only supports openai, not other models. Thanks, Ian

ianmacartney avatar May 17 '23 23:05 ianmacartney

Happy to work on this or accept a PR. What is the use case you intend? Small bundle size? What other Chat APIs could llm.ts build an interface over?

r2d4 avatar May 18 '23 01:05 r2d4

My use case is a small bundle that can run in a non-node environment (that doesn't depend on node-fetch, axios, or other libraries). I thought there would be other chat APIs, but they seem to mostly be self-hosted or not expose an API, like hugging chat or mlc-ai/web-llm.

ianmacartney avatar May 18 '23 03:05 ianmacartney