chatGPTBox
chatGPTBox copied to clipboard
Allow provider-level management for custom models to simplify setup
Is your feature request related to a problem? Please describe. Currently, when adding custom models, the LLM provider and corresponding API key cannot be reused. This makes it inconvenient to add multiple models under a single provider.
Describe the solution you'd like It would be helpful to introduce provider-level management for "OpenAI API compatible providers," allowing users to manage multiple custom models under the same provider and API key. This would lower the barrier for configuring multiple models and make the setup more user-friendly.
Additional context This change could streamline the process and improve scalability for teams and individual users. Open to ideas and discussion on possible solutions or implementation strategies.
This may also help ease code base management, as OpenAI-compatible APIs won't require duplicated code; we can simply use "configs" to maintain these LLM providers.