tensorrtllm_backend icon indicating copy to clipboard operation
tensorrtllm_backend copied to clipboard

InternVL deploy

Open ChenJian7578 opened this issue 10 months ago • 1 comments

I have completed the generation of the engine according to the tutorial, is there a relevant example tutorial for the end to end triton deploy. In addition, when making the visual encoder engine, I found that the pre-processing class of the image is pulled from the hf website initialization information, which seems not very friendly, why not directly use the local configuration file for initialization.

ChenJian7578 avatar Dec 13 '24 01:12 ChenJian7578