llm icon indicating copy to clipboard operation
llm copied to clipboard

Enable setting all options via ENV vars

Open vartec opened this issue 2 months ago • 0 comments

Allow setting all options via environment variables using LLM as the default prefix.

Note that for groups (subcommands) the prefix includes group name; LLM_{group:upper}.

Example:

$ LLM_CHAT_MODEL_ID=mistral-7b-instruct-v0 llm chat 
Chatting with mistral-7b-instruct-v0
⋮
$ llm chat
Chatting with gpt-3.5-turbo
⋮
$ export LLM_CHAT_MODEL_ID=mistral-7b-instruct-v0
$ llm chat
Chatting with mistral-7b-instruct-v0
⋮

vartec avatar Apr 20 '24 21:04 vartec