TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

InternVL-Chat-V1.5 support

Open chiquitita-101 opened this issue 1 year ago • 4 comments

pleaseeeeee, InternVL-Chat-V1.5 surpasses many proprietary multi-modal models, very powerful, pleaseeeee.

chiquitita-101 avatar May 09 '24 10:05 chiquitita-101

Hi, Is InternVL-Chat-V1.5 suported now?

diandianliu avatar May 31 '24 07:05 diandianliu

Hi, Is InternVL-Chat-V1.5 suported now?

Hi @AdamzNV @ncomly-nvidia @juney-nvidia , would please add some comments here?

nv-guomingz avatar Jun 03 '24 09:06 nv-guomingz

We don't support this model yet. According to download statistics from Hugging Face, its popularity has been declining for the past half month.

AdamzNV avatar Jun 03 '24 11:06 AdamzNV

mark

Hukongtao avatar Jul 19 '24 05:07 Hukongtao

mark

LatentLinker avatar Jul 26 '24 10:07 LatentLinker

We don't support this model yet. According to download statistics from Hugging Face, its popularity has been declining for the past half month.

@AdamzNV Please take a look at this ranking list. The score of the InternVL model is in the top 2. https://rank.opencompass.org.cn/leaderboard-multimodal/?m=REALTIME

AmazDeng avatar Sep 04 '24 09:09 AmazDeng

Hi @AmazDeng we just enabled internvl2 supporting. do u still have further issue or question now? If not, we'll close it soon.

nv-guomingz avatar Nov 14 '24 03:11 nv-guomingz

@nv-guomingz Wow, that looks great

LatentLinker avatar Nov 14 '24 04:11 LatentLinker

Hi @AmazDeng we just enabled internvl2 supporting. do u still have further issue or question now? If not, we'll close it soon.

@nv-guomingz Thank you for your work. Could you please provide the link to the relevant documentation?

AmazDeng avatar Nov 14 '24 05:11 AmazDeng

Hi @AmazDeng we just enabled internvl2 supporting. do u still have further issue or question now? If not, we'll close it soon.

@nv-guomingz Thank you for your work. Could you please provide the link to the relevant documentation?

https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/multimodal#internvl2

nv-guomingz avatar Nov 15 '24 17:11 nv-guomingz

https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/multimodal#internvl2

@nv-guomingz I checked the documentation, and tensorrt-llm only supports InternVL2-1B to InternVL2-26B. So, does tensorrt-llm support InternVL2-40B?

AmazDeng avatar Nov 18 '24 02:11 AmazDeng

https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/multimodal#internvl2

@nv-guomingz I checked the documentation, and tensorrt-llm only supports InternVL2-1B to InternVL2-26B. So, does tensorrt-llm support InternVL2-40B?

I'm not the owner of this model but I think 40B should be supported if it's just a large varaint of InternVL2.

nv-guomingz avatar Nov 19 '24 00:11 nv-guomingz