tensorrt

tensorrt copied to clipboard

Error in TensorRT conversion of e5-large model

1

I am trying to convert the open source e5-large TF model to TensorRT. This is the model - https://huggingface.co/intfloat/multilingual-e5-large. I am getting below error [libprotobuf FATAL external/com_google_protobuf/src/google/protobuf/stubs/stringpiece.cc:50] size too big:...

ndeep27

## Description I transfer my model to tensorrt engine using tftrt in IN8. However, the speed is same as FP32 even FP16. I also change minimum_segment_size to 2, 3, 5,...

doublexxking

No significant performance improvement on UNET semantic segmentation model.

6

Hi, I used TFTRT to optimize the 3D UNET segmentation. I couldn't find any significant improvement in the speed. On a P100 GPU, for a batch size of 4 averaged...

dhinkris

RuntimeError: Tensorflow has not been built with TensorRT Support

1

Hello, I was trying out tensorflow tensorRT on the Google Colab to get some hands-on experience with tensorRT , but the code suggested in the repository is not working. **https://github.com/tensorflow/tensorrt/blob/master/tftrt/benchmarking-python/image_classification/Colab-TFv2-TF-TRT-inference-from-Keras-saved-model.ipynb**...

Raghu-dev-pixel