candle icon indicating copy to clipboard operation
candle copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Plans to support AMD

Open countradooku opened this issue 7 months ago • 3 comments

Are there any plans to support inference with AMD gpus? As far as I can tell in Candle there is only support for NVIDIA gpus. i am working on safe rust wrappers for the rocm stack here: https://github.com/radudiaconu0/rocm-rs

maybe you are interested in this. And we can collaborate somehow.

countradooku avatar May 02 '25 17:05 countradooku

there's been an open issue for a while now.

I began working on hip_rs but it's been on-and-off.

smedegaard avatar May 04 '25 18:05 smedegaard

hello @smedegaard i already have hip wrappers in rust :) maybe we can collaborate. i have full rocm libs coverage. i talked with @EricLBuehler on https://github.com/radudiaconu0/rocm-rs/issues/1 . h likes my working. he now tries to run some kernels

countradooku avatar May 04 '25 19:05 countradooku

nice @radudiaconu0 ! I've been using hip-rs as a learning project, so I'll keep plucking away at it. Just wanted to let you know that there has been previous work done.

smedegaard avatar May 04 '25 19:05 smedegaard