yolo_flutter icon indicating copy to clipboard operation
yolo_flutter copied to clipboard

Slow inference on static images

Open fransay opened this issue 2 years ago • 3 comments

I am looking at a way, we could use your implementation on live object detection. But looks like inference on static images alone are quite slow. Will be learning more about your design and algorithm and see we can improve it.

Great job the way :+1:

fransay avatar Nov 20 '23 01:11 fransay

I would be interested by doing that too but I'm a bit afraid of the slowness of the static image right now.

JobiJoba avatar Nov 23 '23 02:11 JobiJoba

Yeah, it is true, the current implementation takes really too much time. And I'm not even sure which could be the issue. It could be:

  • YOLO (e.g. the model is not well optimized to run on tflite)
  • The tflite flutter library (maybe not yet very optimized)
  • The app (maybe I did not enabled some option that unlocks more performance)

While the NMS algorithm could be easily speeded up, and maybe I will do it in the near future. But at the moment it takes only a fraction of time of the inference time

Feel free to open PRs that fix this problem

ferraridamiano avatar Nov 25 '23 14:11 ferraridamiano

Seems like a flutter_tflite issue: https://github.com/tensorflow/flutter-tflite/issues/112

ferraridamiano avatar Dec 03 '23 14:12 ferraridamiano

似乎是 flutter_tflite 的问题:tensorflow/flutter-tflite#112

https://github.com/tensorflow/flutter-tflite/issues/112#issuecomment-2769850318

ctycode avatar May 01 '25 14:05 ctycode

Fixed by 35d8a10b0bd84a56844a5534c28bcb750a5fb16a

ferraridamiano avatar May 03 '25 13:05 ferraridamiano