Dennis Huang
Dennis Huang
您好,ArkInfer将于近期开源,敬请期待!
@WiedenWei It seems like the model hasn't been fully downloaded. Please make sure your local model is completely downloaded.
Yes, absolutely! Setting HF_ENDPOINT=https://hf-mirror.com is a perfect and super common way to avoid those pesky network issues when downloading models. Also, as an alternative, you might want to try downloading...
You can try to change `LLM_TYPE="minicpm"` to `LLM_TYPE="qwen"` in your script—MiniCPM-V-2.6 is built on the Qwen architecture, so that’s likely why you’re hitting the image token mismatch error.