Niloofar Zarif

icon indicating a website link https://www.linkedin.com/in/niloofar-zarif-775a2866/

icon company University of British Columbia icon location Vancouver, BC, Canada icon location A Systems and ML enthusiast, building High-Performance Infrastructure for AI

Results 3 comments of Niloofar Zarif

Internvl3 awq quantization model

Thank you for providing the AWQ model. Can you please check the model card? The instructions on the model card for using the model seem not to be up-to-date for...

[model request] PaliGemma support

Hi, I wanna also up this request and ask if you have plans for adding PaliGemma support to TensorRT-LLM? If yes, can you please provide an estimate on when approximately...

InternVL deploy

Hi @ChenJian7578 , Did you manage to serve InternVL with Triton? If yes, can you please briefly mention the steps you took? Thanks!