Fabric icon indicating copy to clipboard operation
Fabric copied to clipboard

CLI Model - ModelList New Args

Open Gilgamesh555 opened this issue 1 year ago • 3 comments

Changes.

  • Add new arg to CLI - model (-m --model) - which has the value gpt-4-turbo-preview by default
  • Add new arg to CLI - list_model (--listmodels) - gives all the current gpts availables to use and change it
  • ~Include the list of gpts availables statically, until found a way to get the API~
  • gpt model list now is shown based on user's model availability (user api key)

Refer to issue: Issue #41

Gilgamesh555 avatar Feb 06 '24 13:02 Gilgamesh555

Great stuff. Looks good to me. And even better if we were to integrate another single API-Request that checks which models are even available according the restrictions of the API Key ;-)

curl https://api.openai.com/v1/models \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -H "OpenAI-Organization: YOUR_ORG_ID"

chrissonntag avatar Feb 06 '24 15:02 chrissonntag

thanks I will update it

Gilgamesh555 avatar Feb 06 '24 18:02 Gilgamesh555

Really nice! Once the PR has been merged, I'll do the same with integrating the Ollama Python Framework. There's already been a request for the use of LocalLLMs. And I've already done it locally for a proof of concept.

chrissonntag avatar Feb 06 '24 18:02 chrissonntag