fabric
fabric copied to clipboard
Give option to expose all models
As I currently do not have a GPU that allows me to use bigger models locally I'm using a local litellm install to run my models on Amazon Bedrock and expose them through the openai API provided by litellm. Sadly these models do not appear in the gpt model list due to the filter here:
https://github.com/danielmiessler/fabric/blob/34ddf697502d563e068256a12b5e063905271daf/installer/client/cli/utils.py#L424
It would be great to provide an option to list all models and change the naming from GPT to OpenAI compatible models.
Setting the model manually via the --model parameter works, so I believe the listing adjustment is all that's required.