fabric icon indicating copy to clipboard operation
fabric copied to clipboard

[Question]: Is there a easy way to select a model from a different vendor in the command-line ?

Open everaldo opened this issue 2 months ago • 5 comments

What is your question?

After reading the documentation, I am still not clear how to change the model from a distinct vendor. I tried using the --model parameter, but it didn'work.

What worked:

Redefining env vars: DEFAULT_VENDOR and DEFAULT_MODEL

For instance, my DEFAULT_VENDOR is Mistral and DEFAULT_MODEL is open-mixtral-8x22b-2404

If I try fabric --model=gpt-4o, it doesn't work

What I have to do: DEFAULT_VENDOR=OpenAI DEFAULT_MODEL=gpt-4o fabric "prompt"

I would like to know if there is an easier way to do that, since I have multiple vendors: Ollama, Mistral, OpenAI, Groq etc.

Thanks a lot and congrats for this great project.

everaldo avatar Dec 20 '24 03:12 everaldo