exllama icon indicating copy to clipboard operation
exllama copied to clipboard

Published 20 hours ago • verified publisher icon turboderp

Support for AMD ROCM

Open yehowshuaradialrad opened this issue 2 years ago • 1 comments

I have a machine with Mi25 GPUs. Would anybody like SSH access to develop on it for exllama?

yehowshuaradialrad avatar Aug 30 '23 13:08 yehowshuaradialrad

Exllama already works with ROCm, just not at full performance

TNT3530 avatar Aug 30 '23 17:08 TNT3530