BLIP icon indicating copy to clipboard operation
BLIP copied to clipboard
verified publisher icon salesforce

Convert BLIP model to TensorRT

Open Frostbite22 opened this issue 2 years ago • 1 comments

Hello, Is there any any to convert BLIP to TensorRT to have a lighter model on inference time ?

I have tried to convert the model to ONNX first ( then I will convert it to TensorRT in the next step) but I failed.

Frostbite22 avatar Jul 26 '23 09:07 Frostbite22

Any update? I also faiiled to convert BLIP model to TorchScript.

Hello, Is there any any to convert BLIP to TensorRT to have a lighter model on inference time ?

I have tried to convert the model to ONNX first ( then I will convert it to TensorRT in the next step) but I failed.

ymzlygw avatar Feb 27 '24 09:02 ymzlygw