open-notebook
open-notebook copied to clipboard
[Feature]: New Providers Page
Feature Description
We need to help our users handle multiple providers in an easier way. Today, each provider requires different environment variables for API Keys, Base URLs, etc. This is confusing to most users and forces them to redeploy the app to make any change.
We will move towards the idea of Providers.
- A new database table for provider
- Users can create as many providers as required even 2 openai providers for instance if they need
- There will be a dictionary defining all data we need to acquire for each provider
- Users will be able to type that data on the app and have it saved to the database
- Models will also be created for a specific provider which will require a migration on the models table as well
- We will also need to redesign the models page in the UI for it.
Why would this be helpful?
This will make it easier for new users and people that are willing to experiment with a lot of providers.
Additional Context
No response
yeah, need to add all of arbitrary endpoints support... e.g. Qwen3-235B-A22B-Instruct-2507, Qwen3-Coder-30B-A3B-Instruct, Qwen3-VL-8B-Instruct, Qwen3-VL-4B-Instruct... up to users for llama-server, no limit, thanks