TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

support llava-next model

Open AmazDeng opened this issue 1 year ago • 0 comments

Llama-next-image and Llama-next-image are fairly good multimodal models, and they are already supported in transformers. I would like to know if tensorrt-llm plans to support these two models?

https://github.com/LLaVA-VL/LLaVA-NeXT https://huggingface.co/docs/transformers/model_doc/llava_next https://huggingface.co/docs/transformers/model_doc/llava-next-video

AmazDeng avatar Jul 05 '24 09:07 AmazDeng