candle icon indicating copy to clipboard operation
candle copied to clipboard

Can we accelerate the onnx model with a GPU from candle?

Open Baiyuetribe opened this issue 7 months ago • 0 comments

ref: https://github.com/huggingface/candle/blob/main/candle-examples/examples/onnx/main.rs

I see that the underlying implementation all uses candle, so theoretically it should be supported, right?

Baiyuetribe avatar Apr 20 '25 13:04 Baiyuetribe