Performance Degradation with YOLOv5 on CPU – Need Assistance in Improving FPS

[ranjith502]

Dear play_with_tflite Contributors,

First and foremost, I would like to extend my sincere gratitude for your hard work in developing this library. It has been immensely beneficial to my learning journey, and I appreciate the clarity and quality of the code.

I am currently facing a performance issue while running YOLOv5lite on a CPU. I've made some modifications to main.cpp to enable camera support. Initially, the software runs as expected with a frame rate of approximately 10-12 FPS. However, after the first 10 frames, I observe a significant drop in performance, with FPS values plummeting to around 2-3 FPS.

This performance bottleneck is a critical issue for my project, as I aim to achieve near real-time processing speeds, ideally around 25 FPS, on a CPU-only setup. I understand that running advanced models like YOLOv5 exclusively on a CPU can be challenging, but I am seeking advice or potential optimizations that could help in improving the frame rate.