candle
candle copied to clipboard
Slow YOLOv8 using MKL
I had great success using MKL for some models, especially BERT-likes with huge improvements in speed (up to x25). Here the speedup is only of about 1 second. However, I'm having troubles with the YOLOv8-X model which is very slow (same speed as PyTorch) and about 6 times slower than Onnx. Are operations in YOLO not supported by MKL ?
Note that I'm using a fine tuned model, with bigger images so I expect it to be slow but I was expecting MKL to perform well. The same is happening with the provided example in the README. Also, I don't see any improvements with the accelerate feature on my M2.
Thanks for you help