open-notebook icon indicating copy to clipboard operation
open-notebook copied to clipboard

[Feature]: New Providers Page

Open lfnovo opened this issue 2 months ago • 1 comments

Feature Description

We need to help our users handle multiple providers in an easier way. Today, each provider requires different environment variables for API Keys, Base URLs, etc. This is confusing to most users and forces them to redeploy the app to make any change.

We will move towards the idea of Providers.

  • A new database table for provider
  • Users can create as many providers as required even 2 openai providers for instance if they need
  • There will be a dictionary defining all data we need to acquire for each provider
  • Users will be able to type that data on the app and have it saved to the database
  • Models will also be created for a specific provider which will require a migration on the models table as well
  • We will also need to redesign the models page in the UI for it.

Why would this be helpful?

This will make it easier for new users and people that are willing to experiment with a lot of providers.

Additional Context

No response

lfnovo avatar Nov 01 '25 18:11 lfnovo

yeah, need to add all of arbitrary endpoints support... e.g. Qwen3-235B-A22B-Instruct-2507, Qwen3-Coder-30B-A3B-Instruct, Qwen3-VL-8B-Instruct, Qwen3-VL-4B-Instruct... up to users for llama-server, no limit, thanks

zhudy avatar Nov 08 '25 08:11 zhudy