void icon indicating copy to clipboard operation
void copied to clipboard

Add second openai compatible provider

Open steaks opened this issue 6 months ago • 1 comments

#244 Add a second OpenAI Compatible provider

This is a quick fix, but a little hacky. So I wanted to get some eyes on it to see if this is the direction we should go down.

Screenshots

Providers

providers

Models

models

steaks avatar Jun 13 '25 00:06 steaks

Maybe like down the bottom where you click to add model, you could click to add API provider? Have an arbitrary number of them?

You would need a way to remove them, also.

Urammar avatar Jun 20 '25 20:06 Urammar

I am also interested in this because I do have different local machines or maybe even the same machine that's running multiple VLLM endpoints. With different models

chriswritescode-dev avatar Jun 30 '25 16:06 chriswritescode-dev

@Urammar thanks for the suggestion. I moved the open-ai compatible providers to the bottom. And I have a little collapse/expand ui. I updated the pr description with screenshots.

steaks avatar Jul 07 '25 02:07 steaks

@andrewpareles I updated the UI, so this PR is ready for review.

steaks avatar Jul 07 '25 02:07 steaks

Great, thanks!

andrewpareles avatar Jul 07 '25 02:07 andrewpareles