Can I use my Radeon 5500 for private gpt?

Open TechnicalityMods opened this issue 1 year ago • 1 comments

I am using the Local Ollama-powered setup, and it doesn't use my gpu at all, and is really slow. I am wondering if I can use my gpu in some way to give faster results and take some of the load off of my cpu. Thanks in advance!

Apr 11 '24 13:04 TechnicalityMods

Maybe this one can help you out. https://github.com/ROCm/ROCm/discussions/2629 Not sure which 5500 you have.

Apr 27 '24 08:04 MarslMarcello

Is it issue

Jul 10 '24 11:07 jaluma