fabric icon indicating copy to clipboard operation
fabric copied to clipboard

Give option to expose all models

Open tott opened this issue 8 months ago • 0 comments

As I currently do not have a GPU that allows me to use bigger models locally I'm using a local litellm install to run my models on Amazon Bedrock and expose them through the openai API provided by litellm. Sadly these models do not appear in the gpt model list due to the filter here:

https://github.com/danielmiessler/fabric/blob/34ddf697502d563e068256a12b5e063905271daf/installer/client/cli/utils.py#L424

It would be great to provide an option to list all models and change the naming from GPT to OpenAI compatible models.

Setting the model manually via the --model parameter works, so I believe the listing adjustment is all that's required.

tott avatar May 31 '24 06:05 tott