tensorRT in c++

[antithing]

Hi! Thank you for making this available. DO you have any plans to create a TensorRT c++ inference example? Or, are you aware of one?

Thanks!

[sarlinpe]

This is not in our immediate plans but we would like to get to this at some point. I am not aware of any other effort besides https://github.com/fabio-sim/LightGlue-ONNX. ONNX/TensorRT does not support dynamic control flow, so a naive export cannot leverage the full savings of LightGlue (adaptive depth). Exporting each layer independently could maybe resolve this.

[fettahyildizz]

Is there anyone who is able to inference in C++ using tensorRt?