pytorch transformer - onnx -tensorrt conversion error

[syoungbaak]

I got the onnx file which is converted from a pytorch script including the transformer module with opset version 11 and onnx 1.10.

When I tried to convert it using onnx-tensorrt, I got the following errors:

Gather_24: index to gather must be non-negative getPluginCreator could not find plugin: Xor version: 1

Can anyone help me to solve the errors ?

Thanks, Seungyoung

[kevinch-nv]

What TensorRT version are you using? These issues should be addressed in the latest release (TRT 8.2)

[syoungbaak]

What TensorRT version are you using? These issues should be addressed in the latest release (TRT 8.2)

Thank you for your reply.

I was using TensorRT 8.0.1.6 which was included in JetPack 4.6 at Jetson Nano.

It would be better to wait till JetPack 5.0 is released.

[fschvart]

I'm not sure that this is solved. ONNX-TensorRT conversion doesn't support Xor operator, I imagine that's the problem. https://github.com/onnx/onnx-tensorrt/blob/main/docs/operators.md

I have the same problem. I was able to create two ONNX models that I want to convert to TRT, I has Xor and the other has a dynamic TopK :(