jan icon indicating copy to clipboard operation
jan copied to clipboard

Published 20 hours ago • verified publisher icon janhq

feat: ROCm support on Linux for dedicated AMD Radeon GPUs

Open tejasraman opened this issue 1 year ago • 3 comments

Problem I use Jan on my Linux PC with an AMD dedicated (ROCm-supported) card. However, HIP/ROCm support for Jan is not present, so models are still run on the CPU.

Success Criteria In order for this proposal to be successful, full support for ROCm (and, optionally, AMD's legacy Polaris OpenCL implementation) should be added and be accessible through the same settings menu as CUDA acceleration.

tejasraman avatar Apr 11 '24 02:04 tejasraman

Use Experimental settings in Jan to turn on Vulkan for your GPU, Jan uses Nitro and it uses Vulkan APIs currently instead of ROCm, but ROCm API support would be nice alt.

metaspartan avatar Apr 11 '24 05:04 metaspartan

Is ROCm expected to perform better than the current implementation of Vulkan on Linux?

xtarlit avatar Apr 21 '24 05:04 xtarlit

related to https://github.com/janhq/cortex/issues/323

Van-QA avatar Apr 23 '24 08:04 Van-QA

We received 10+ comments on AMD support yesterday. Is it possible to prioritize it?

eckartal avatar Jun 21 '24 02:06 eckartal

Closed as duplicated with https://github.com/janhq/cortex/issues/323

hantran-co avatar Sep 02 '24 12:09 hantran-co