the tensorrt is slow than pytorch

[archwolf118]

Thank you for this wonderful project. But I met a problem in python api of tensorrt to inference the model which is trained on pytorch. I found the speed is slower in tensorrt than pytorch. Like this project, I have 7226 classes of char, so the speed is 2.9ms/pic (32*100) in tensorrt (if dynamic input, the speed is 9ms/pic) . But when I test the same picture in pytorch(pytorch is dynamic input), it show only 3ms/pic. Have you test the speed in pytorch?