candle icon indicating copy to clipboard operation
candle copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Candle vs. PyTorch performance

Open ohaddahan opened this issue 3 months ago • 8 comments

I'm running https://github.com/huggingface/candle/tree/main/candle-examples/examples/llava vs. https://github.com/fpgaminer/joycaption/blob/main/scripts/batch-caption.py on a Mac m1.

Seeing significant performance difference, Candle seems much slower. I enabled accelerate and metal features.

Would love some pointers how to improve it.

ohaddahan avatar Aug 11 '25 16:08 ohaddahan