config for the server to change the location of the models

[aemonge]

Can we have a /etc/ollama.json file to change the default path for the models?

[oliverbob]

This could be useful for migration scenarios.

[pdevine]

@aemonge you can change this right now with the OLLAMA_MODELS env variable. What platform are you using?

[aemonge]

I'm using arch linux.

I know, I can change individual MODEL settings, but would be nice to have a global config

[bmabir17]

@aemonge you can change this right now with the OLLAMA_MODELS env variable. What platform are you using?

@pdevine can suggest how i can use this env variable while serving ollama with docker ?

[easp]

@aemonge the OLLAMA_MODELS environment variable isn't a per-model setting. It's global. https://github.com/ollama/ollama/blob/main/docs/faq.md#how-do-i-set-them-to-a-different-location

[oliverbob]

But what if we not only choose the location of the model but "migrate" the entire model entries? Docs for permissions, rsync or whatever should be included, because by nature, "ollama" is "bound" to scale.

[aemonge]

Thanks for the clarification @easp