Support custom model names

[johnd0e]

Currently, there are two distinct OpenAI options in the providers list: "gpt-3.5 turbo" and "gpt-4 turbo". It would be more efficient to consolidate these into a single item, with the capability to switch between different models. Naturally, the ability to assign custom model names is necessary.

The same improvements should also be made for Claude, LLama, and Mistral.

[pymike00]

Hi there,

Yes, duplicating the handler instantiation like that is probably not the cleanest of solutions, I will see what can be done without compromising simplicity too much while refactoring.

If you had any initial thoughts feel free to share them here!

[johnd0e]

If you had any initial thoughts feel free to share them here!

I see several alternatives

• Common models list, with possibility to add there any model by any provider. Additionally there could be "Filter by provider" , drop-down control.
• 2 separate lists in dropdown controls: Provider / Model, with possibility to add any custom model. It would be good, if we could add custom providers as well. By "custom provider" I mean any OpenAI-, or Google Gemini-compatible service, which can be defined with its URL (#6)