ai-toolkit icon indicating copy to clipboard operation
ai-toolkit copied to clipboard

Support for AMD ROCm compatible GPUs.

Open cupertinomiranda opened this issue 3 weeks ago • 5 comments

This patch adds support for AMD ROCm capable GPUs to the project, for Linux at the moment.

Hope you find the implementation sane and complete. I have been using it for the last couple of days with great success.

dashboard job1

cupertinomiranda avatar Dec 02 '25 22:12 cupertinomiranda

No plan at windows radeon support?

dkspwndj avatar Dec 02 '25 22:12 dkspwndj

No plan at windows radeon support?

If by Radeon support you mean any card that has ROCm support, then the answer is yes. However, I will need some time to setup a windows environment to try it. It would be nice if someone with a Windows setup could contribute it, considering that it could be a very easy patch.

It works with other low end cards as well. It is in no way limited to the AI PRO R9700.

cupertinomiranda avatar Dec 02 '25 22:12 cupertinomiranda

There's an issue for systems with an inactive iGPU on line 147 of ui/src/app/api/gpu/route.ts. The JSON returned for an inactive iGPU has an empty usage attribute.

Here's what the first chunk of an iGPU looks like:

"gpu_data": [
    {
        "gpu": 1,
        "usage": "N/A",
        "power": {
            "socket_power": "N/A",
            "gfx_voltage": "N/A",
            "soc_voltage": "N/A",
            "mem_voltage": "N/A",
            "throttle_status": "N/A",
            "power_management": "N/A"
        },

The missing data kills the parsing and prevents other GPUs from being detected.

ptelder avatar Dec 07 '25 07:12 ptelder

Thanks for the comment. Will change the patch with a renewed improved version.

cupertinomiranda avatar Dec 07 '25 09:12 cupertinomiranda