tensorrtx icon indicating copy to clipboard operation
tensorrtx copied to clipboard

第一次推理时间慢,后面正常

Open hnothing2016 opened this issue 2 years ago • 1 comments

Env

  • GPU, RTX1660
  • OS, Win10
  • Cuda version 11.1
  • TensorRT 8.2.1

About this repo

  • which branch/tag/commit are you using? 6.0
  • which model? yolov5x

Your problem

第一次推理时间要 531ms后面就快了,50ms左右,这个是正常情况吗?

微信截图_20220531140415

hnothing2016 avatar May 31 '22 06:05 hnothing2016

This is normal, GPU needs warmup.

wang-xinyu avatar Jun 29 '22 03:06 wang-xinyu

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Aug 31 '22 02:08 stale[bot]