QUESTION: change the save path for models

[yonghongwu]

How can I set my own save path instead of ${user}/. xinreference/cache

[waltcow]

I have similar question too. I download models from huggingface via aria2, cause it can download with multi thread support. After downloaded, don't know how to put the models file to which directory

[aresnow1]

Refer to the documentation: https://inference.readthedocs.io/en/latest/getting_started/using_xinference.html#configure-xinference-home-path

[aresnow1]

I have similar question too. I downloa models from huggingface via aria2, cause it can download with multi thread support. After downloaded, don't know how to put the models file to which directory

It is not recommended to copy the model to the cache directory. You can use the mechanism of registering models to use your own local model. Here's doc: https://inference.readthedocs.io/en/latest/models/custom.html, or you can register on Web UI.

[github-actions[bot]]

This issue is stale because it has been open for 7 days with no activity.

[github-actions[bot]]

This issue was closed because it has been inactive for 5 days since being marked as stale.