text-generation-webui
text-generation-webui copied to clipboard
OpenAI extension list currently loaded models not dummy models.
Fixes bug #5675 that lists dummy models instead of loaded models in OpenAI extension. v1/models
.
Checklist:
- [ x] I have read the Contributing guidelines.
What will this do to tools that expect openAI models or choose them?
@Ph0rk0z That is one of my concerns. When using integrations like continue.dev the proper models do not load via the open ai api endpoints, only dummy ones that do not work. Although if another integration is required to have to have the open ai models to verify its working then this could cause it to fail. I'm wondering if potentially a flag could denote whether or not to use dummy models.
Why not just add gpt4/3.5 fake model strings in addition to the actual models and make those not switch the current model? Kill two birds with one stone in a way.
@Ph0rk0z That sounds like the best of both worlds, and easy to implement. I will update the pull to do that when I get a minute.