bark icon indicating copy to clipboard operation
bark copied to clipboard

Can Bark support acceleration with AMD GPU with ROCM?

Open eliranwong opened this issue 1 year ago • 2 comments

Can Bark support acceleration with AMD GPU with ROCM?

eliranwong avatar Apr 29 '24 09:04 eliranwong

I added partial support in my fork, but it's via DirectML and pretty buggy, and last I checked the DirectML Pytorch component hasn't been updated for a year. Keep an eye on this fork: https://github.com/PABannier/bark.cpp they may eventually get AMD support.

JonathanFly avatar May 25 '24 04:05 JonathanFly

Linux users use ROCM

eliranwong avatar May 26 '24 18:05 eliranwong