candle icon indicating copy to clipboard operation
candle copied to clipboard

Slow YOLOv8 using MKL

Open hugohmn opened this issue 1 year ago • 0 comments

I had great success using MKL for some models, especially BERT-likes with huge improvements in speed (up to x25). Here the speedup is only of about 1 second. However, I'm having troubles with the YOLOv8-X model which is very slow (same speed as PyTorch) and about 6 times slower than Onnx. Are operations in YOLO not supported by MKL ?

Note that I'm using a fine tuned model, with bigger images so I expect it to be slow but I was expecting MKL to perform well. The same is happening with the provided example in the README. Also, I don't see any improvements with the accelerate feature on my M2.

Thanks for you help

hugohmn avatar Jun 21 '24 14:06 hugohmn