Add second openai compatible provider
#244 Add a second OpenAI Compatible provider
This is a quick fix, but a little hacky. So I wanted to get some eyes on it to see if this is the direction we should go down.
Screenshots
Providers
Models
Maybe like down the bottom where you click to add model, you could click to add API provider? Have an arbitrary number of them?
You would need a way to remove them, also.
I am also interested in this because I do have different local machines or maybe even the same machine that's running multiple VLLM endpoints. With different models
@Urammar thanks for the suggestion. I moved the open-ai compatible providers to the bottom. And I have a little collapse/expand ui. I updated the pr description with screenshots.
@andrewpareles I updated the UI, so this PR is ready for review.
Great, thanks!