ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard
verified publisher icon intel-analytics

support InternVL-8B model on Arc A770

Open Fred-cell opened this issue 1 year ago • 1 comments

https://modelscope.cn/models/OpenGVLab/InternVL2-8B#%E7%AE%80%E4%BB%8B image support this model base 2x Arc A770

Fred-cell avatar Aug 26 '24 07:08 Fred-cell

Hi @Fred-cell ,

We tried to enable InternVL2-8B on vllm 2-card serving, while an open issue about vllm is found that blocks this model. We will keep paying attention to it.

Uxito-Ada avatar Aug 27 '24 01:08 Uxito-Ada

Any updates on this? Seems the vllm issue was fixed in September (in vLLM >0.6.0).

vladislavdonchev avatar Jan 02 '25 16:01 vladislavdonchev

InternVL2-8B is enabled by this pr.

hzjane avatar Jan 06 '25 01:01 hzjane