bug: When AMD Radeon is selected in Hardware, System Monitor fails with error

[nikiluk]

Jan version

0.6.1

Describe the Bug

When AMD Radeon is selected in Settings/Hardware, System Monitor fails and does not display anything.

In all other cases, the System Monitor works as expected.

Also, please, make it easier to access the System Monitor

Steps to Reproduce

1. Go to Settings/Hardware
2. Select AMD Radeon integrated GPU (in my case GPU 1)
3. Press System Monitor
4. Get error

Screenshots / Logs

What is your OS?

• [ ] MacOS
• [x] Windows
• [ ] Linux

[david-menloai]

Thank you for the clear report @nikiluk @urmauur please help take a look 🙏

[david-menloai]

somehow, cortex can't get your AMD driver... do you mind updating your GPU (AMD) driver to the latest version and try again @nikiluk ?

[nikiluk]

This does not seem to resolve the issue in any way @urmauur

Even with the drivers updated to the latest version, the driver version is not detected.

Also, interestingly, while installing the driver updates for AMD, I've noticed an AI Tab in their Adrenalin Software. This tab lists so-called AI apps and Jan was not in the list, while LM Studio was there.

[david-menloai]

hey @louis-menlo I think there is a problem detection GPU version (probably cortex issue) he has upgraded the driver to the latest one but the issue still occured can you please help take a look?

@nikiluk quick quesiton, if you're selecting AMD as the GPU, can Jan leverage your GPU for AI models 🤔 or it's just a problem with the driver version 🤔

[louis-jan]

Hi @nikiluk, we are not yet fully support AMD GPU yet (likely 0.7.0) where HIP thingy comes. For now please help us toggle on Vulkan toggle to have models utilize AMD GPU.

[nikiluk]

Hi @david-menloai

can Jan leverage your GPU for AI models 🤔

I can try, how can I test that? What should we see? For now I think yes, as when Vulkan is ON I see lower CPU load and higher integrated GPU load. But IDK if exactly this is expected

[david-menloai]

hi @nikiluk Yes, for NVIDIA card, you won't see any involvement of CPU but for AMD card, it will (current solution is vulkan). As we're still trying to adopt ROCm which will be leveraging GPU only.

[nikiluk]

@david-menloai I confirm that

WHEN Vulkan ON, 
THEN CPU is offloaded 
AND the AMD Software / Performance Monitor shows load on the GPU

---

WHEN Vulkan is OFF
THEN CPU is heavily loaded
AND the AMD iGPU is not showing significant load

[david-menloai]

thank you @nikiluk this is expected actually. As we use Vulkan for AMD so if you want to leverage AMD, you MUST ENABLE Vulkan, otherwise, AMD Card can't be utilized this doesn't sound user-friendly, we will try to enhance this. btw, as we will work on ROCm for AMD specifically, it will natively support AMD Cards without needing CPU (provide higher performance)

Back to your issue, I think something is wrong with the library to get AMD GPU version, we merged a patch so FE will discard showing the GPU version, etc if it's null from the BE side.

we will probably have another patch next week, will let you know when can you test it again Thank you so much for all your help and for giving such clear and detailed information. I really appreciate it.💯

[louis-jan]

Can check this after 0.7.0, where we integrate new hardware detection with new llama.cpp integration

[nikiluk]

seems to be fixed already

[david-menloai]

thanks for your confirmation @nikiluk what we addressed is just the FE side where it won't crash the popup. the remaining thing is BE call where we can't get the GPU version. We will continue to investigate this issue

[louis-jan]

Fixed in 0.6.6. Queued up for releasing.