SuperGluePretrainedNetwork icon indicating copy to clipboard operation
SuperGluePretrainedNetwork copied to clipboard

Deploy with TensorRT

Open oym1994 opened this issue 2 years ago • 7 comments

Hi, thanks for your great contribution. Very great job! I want to deploy it in a Jetson AGX platform. The main problem is that the inferring time is far beyond our expectation(c++ 400ms, input 500 -- 500 superpoint, the ideal time should be less than 100ms). I wander if anyone has deployed it in TensorRT platform and is it feasible to do that(all the operations are supported in current TensorRT framework)? Thanks in advance for any kind response.

oym1994 avatar Jan 24 '22 09:01 oym1994

how can you convert pth model to onnx model? can you expain the detail method? thanks ! @oym1994

jcyhcs avatar Feb 10 '22 03:02 jcyhcs

Did someone manage to convert the pth model to onnx model? I would aprreciate it if someone shares his experience

Mehdi-96 avatar Apr 11 '22 13:04 Mehdi-96

Desperately need to convert this model to Tensor-RT but have not be been successful. Did anyone manage to convert the model to tensor-RT? If successful, kindly share your experience.

amk2777 avatar May 05 '22 20:05 amk2777

Deploy with TensorRT: https://github.com/Broad-sky/feature-detection-matching-algorithm

Broad-sky avatar Jul 27 '22 06:07 Broad-sky

https://github.com/Broad-sky/feature-detection-matching-algorithm

Very nice! It would be super great if the conversion script was added 🤞 . PS On what device did you run the example? What would the performance be on the small jetson nano?

deblauwetom avatar Sep 28 '22 08:09 deblauwetom

I have successfully deployed with TensorRT too, with onnx model provided. Please refer to https://github.com/oym1994/ImageFeaturesAndMatching.

oym1994 avatar Feb 01 '23 09:02 oym1994

I have successfully deployed with TensorRT too, with onnx model provided. Please refer to https://github.com/oym1994/ImageFeaturesAndMatching.

Sorry for later response! I have successfully deployed with TensorRT too, with onnx model provided. Please refer to https://github.com/oym1994/ImageFeaturesAndMatching. I hope it will still help you!

oym1994 avatar Feb 01 '23 09:02 oym1994