litellm icon indicating copy to clipboard operation
litellm copied to clipboard

[Feature]: Load all models from endpoint

Open Maralai opened this issue 1 year ago • 1 comments

The Feature

Consider adding a boolean to the new model dialog with "Load all Models" with the help text of "If this field is toggled, we will call the API to retrieve all models from the endpoint; you can edit the model names, inactivate unwanted models, in the edit dialog." When retrieving all the models, you should check for ones already loaded by that endpoint, only adding new ones. To prevent the retrieval of models from the API that are not wanted, you should introduce a new field in the model's table/editor to disable or deactivate them rather than remove them.

image

This would need to be coupled with the feature outlined here: https://github.com/BerriAI/litellm/issues/4466

Motivation, pitch

This feature would allow the retrieval of all models available at the endpoints, leveraging the APIs of each provider. If you have added a few models to Ollama, you could grab them all quickly and then edit/inactivate/rename them after retrieving them. It there a new model from Openai? But you forgot the technical name? Just get all, then manage them in your interface.

Twitter / LinkedIn details

No response

Maralai avatar Jun 30 '24 00:06 Maralai

This would be very helpful!

tkg61 avatar Oct 04 '24 11:10 tkg61

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

github-actions[bot] avatar Jan 28 '25 02:01 github-actions[bot]

bump. This would be a nice time-saver!

suurt8ll avatar Feb 08 '25 09:02 suurt8ll

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

github-actions[bot] avatar May 10 '25 00:05 github-actions[bot]

bump. this would be useful

RajatGarga avatar Jul 18 '25 09:07 RajatGarga