Randel Reiss comments

Repositories
Issues
Comments

Results 2 comments of


                                            Randel Reiss

Option to unload checkpoint or only load checkpoint until used

Ollama framework has a really handy environment and API accessible variable: OLLAMA_KEEP_ALIVE=[# of seconds] | [xM] | 0 I think it's mostly used for people who want the last loaded...

[Feature Request]: Idle mode to save power consumption

Ollama framework has a really handy environment and API accessible variable: OLLAMA_KEEP_ALIVE=[# of seconds] | [xM] | 0 I think it's mostly used for people who want the last loaded...