Dennis Huang

Results 14 comments of Dennis Huang

您好,ArkInfer将于近期开源,敬请期待!

@WiedenWei It seems like the model hasn't been fully downloaded. Please make sure your local model is completely downloaded.

Yes, absolutely! Setting HF_ENDPOINT=https://hf-mirror.com is a perfect and super common way to avoid those pesky network issues when downloading models. Also, as an alternative, you might want to try downloading...

You can try to change `LLM_TYPE="minicpm"` to `LLM_TYPE="qwen"` in your script—MiniCPM-V-2.6 is built on the Qwen architecture, so that’s likely why you’re hitting the image token mismatch error.