tensorrt icon indicating copy to clipboard operation
tensorrt copied to clipboard

Error in TensorRT conversion of e5-large model

Open ndeep27 opened this issue 1 year ago • 1 comments

I am trying to convert the open source e5-large TF model to TensorRT. This is the model - https://huggingface.co/intfloat/multilingual-e5-large. I am getting below error

[libprotobuf FATAL external/com_google_protobuf/src/google/protobuf/stubs/stringpiece.cc:50] size too big: 18446744071659921560 details: string length exceeds max size

I also tried disabling the graph freezing by setting env var - TF_TRT_EXPERIMENTAL_FEATURES=disable_graph_freezing but I get below error for that

RuntimeError: Not found in the function captures: unknown_390:0

Any pointers on how can I resolve above?

ndeep27 avatar Jul 12 '24 00:07 ndeep27

@DEKHTIARJonathan Can you please help with above?

ndeep27 avatar Jul 17 '24 17:07 ndeep27