Running Ollama with Zluda on AMD GPU for CUDA support

[drnushooz]

What are you trying to do?

AMD has an official build of CUDA api on top of ROCm which is called Zluda. This is a placeholder of how ollama runs on various platform with AMD Radeon GPU. Here is the link to Zluda project https://github.com/vosen/ZLUDA

How should we solve this?

Just try to install Zluda on Linux and run Ollama and TensorFlow on it. See if it detects the GPU as CUDA compatible.

What is the impact of not solving this?

No response

Anything else?

No response