The latency of Pointpillars and Centerpoints

[chenxyyy]

Hi, Thank you for your work on the deploy of 3D detection model.

I have test the pointpillars and centerpoints in mmdeploy. But I found that the inference latency is not so good.

The average latency of pointpillars(tensorrt) is about 30ms/frame . And the centerpoint(tensorrt) is about 120ms. After using tensorrt, the speed has not improved. Is this normal?

I got the result on 3080 Graphics card. My tensorrt version is 7.2.3.4.

Looking forward to your reply.