Failed to fetch model 'TabbyML/DeepseekCoder-6.7B' due to 'Invalid mirror <modelscope.cn>
Describe the bug I use mirror of <modelscope.cn>, but when it running , error is that
thread 'main' panicked at /root/workspace/crates/tabby-download/src/lib.rs:74:25:
Failed to fetch model 'TabbyML/DeepseekCoder-6.7B' due to 'Invalid mirror <modelscope.cn> for model urls: ["https://huggingface.co/TheBloke/deepseek-coder-6.7B-base-GGUF/resolve/main/deepseek-coder-6.7b-base.Q8_0.gguf"]'
Information about your version 0.7.0-rc.1
Information about your GPU V100
Additional context I use docker compose to run it
image: tabbyml/tabby:0.7.0-rc.1
command: serve --model TabbyML/DeepseekCoder-6.7B --device cuda
TABBY_DOWNLOAD_HOST: modelscope.cn
Hi, unfortunately, not all models have mirrored to modelscope.cn, you might refer https://github.com/TabbyML/registry-tabby/blob/main/models.json for details.
thank you for your reply, can i download it manually then put it on a directory?
Yes - as long as it’s organized in same way described in https://github.com/TabbyML/tabby/blob/main/MODEL_SPEC.md
then you can pass the local directory path to —model