yolov5 icon indicating copy to clipboard operation
yolov5 copied to clipboard

Published 20 hours ago • verified publisher icon ultralytics

Multiple threads using yolov5 model concurrent inference failed

Open cucyuan opened this issue 6 months ago • 4 comments

Search before asking

  • [X] I have searched the YOLOv5 issues and discussions and found no similar questions.

Question

When I used the yolov5 model for concurrent inference in two threads, after running for some time, the cuda occupancy suddenly reached 100%, and then the program stuck. In addition, I've set inplace=False, but it doesn't work, i hope get help, thank you!!! 1723550610576

Additional

No response

cucyuan avatar Aug 13 '24 12:08 cucyuan