candle icon indicating copy to clipboard operation
candle copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Candle on Mobile

Open Allen1801 opened this issue 9 months ago • 2 comments

can anyone teach me how I can use candle to run llms locally on mobile Im using TauriV2 as my framework

Allen1801 avatar Feb 27 '25 03:02 Allen1801

looks like it's not actually working on mobile for candle

MonolithFoundation avatar Mar 03 '25 10:03 MonolithFoundation

Candle works just fine in tauri mobile. You would run via wasm in the guest, or as usual on the host.

Mobile OSs and browsers (in particular, Apple's) tend to be pretty conservative about handing out resources though, and getting good hardware acceleration across targets (in particular, Google's) can be challenging.

Is there a specific issue you're seeing to suggest it doesn't work?

nicksenger avatar Apr 13 '25 21:04 nicksenger