Tensorflow-TensorRT icon indicating copy to clipboard operation
Tensorflow-TensorRT copied to clipboard

Yolov3 model operation did not accelerate significantly

Open LeeWise9 opened this issue 5 years ago • 2 comments

Hello, thank you very much for sharing. It's a great project. After I use tensor-rt to convert yolov3 model according to your steps, I find that the calculation improvement is not obvious. The FPS of the original model and tensorrt model are about 30. The platform I use is Google colab. It's strange that on a CPU only platform, acceleration is obvious, while GPU platform acceleration is not. I'm very confused about this. What's wrong? (Has Google colab optimized the model calculation?)

LeeWise9 avatar Feb 12 '20 06:02 LeeWise9

Hello, thank you very much for sharing. It's a great project. After I use tensor-rt to convert yolov3 model according to your steps, I find that the calculation improvement is not obvious. The FPS of the original model and tensorrt model are about 30. The platform I use is Google colab. It's strange that on a CPU only platform, acceleration is obvious, while GPU platform acceleration is not. I'm very confused about this. What's wrong? (Has Google colab optimized the model calculation?)

me too

han1366 avatar Mar 10 '20 12:03 han1366

+1 , The speed and model size is the same. However, the number of nodes slightly reduced. Screenshot from 2020-09-28 12-14-27

MuhammadAsadJaved avatar Sep 29 '20 02:09 MuhammadAsadJaved