TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

[model request] PaliGemma support

Open kitterive opened this issue 1 year ago • 1 comments

有计划支持谷歌的paligemma多模态模型吗?

kitterive avatar Jul 11 '24 03:07 kitterive

It seems that PaliGemma's download popularity on Hugging Face is much lower than Llava's.

AdamzNV avatar Jul 18 '24 05:07 AdamzNV

Hi, I wanna also up this request and ask if you have plans for adding PaliGemma support to TensorRT-LLM? If yes, can you please provide an estimate on when approximately it will be available?

Thanks!

nzarif avatar Sep 19 '24 17:09 nzarif

As more and more new models enter the market, we have prepared comprehensive instructions for TRT-LLM developers on adapting to new models of interest. We encourage our community developers to expand the range of supported models, fostering an open ecosystem with rapid iterations.

Please try following these instructions and let us know if you encounter any issues during the adaptation process. We greatly appreciate your dedication.

AdamzNV avatar Oct 31 '24 05:10 AdamzNV