CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

Feature request: AMD GPU support with oneDNN AMD support

Open santhoshtr opened this issue 1 year ago • 16 comments

Hi, CTranslate2 uses oneDNN. oneDNN latest versions has support for AMD GPU. It require Intel oneAPI DPC++. The same approach can potentially enable NVIDIA GPU support too.

It would help running the MT models on AMD GPUs. With Rocm, this would be a full opensource way to run MT models in GPUs.

Thanks

santhoshtr avatar Feb 09 '23 10:02 santhoshtr