TensorRT-LLM
TensorRT-LLM copied to clipboard
support llava-next model
Llama-next-image and Llama-next-image are fairly good multimodal models, and they are already supported in transformers. I would like to know if tensorrt-llm plans to support these two models?
https://github.com/LLaVA-VL/LLaVA-NeXT https://huggingface.co/docs/transformers/model_doc/llava_next https://huggingface.co/docs/transformers/model_doc/llava-next-video