S. Mellouk comments

Results 14 comments of


                                            S. Mellouk

AMD iGPU works in docker with override but not on host

@dhiltgen Integrated GPU

AMD iGPU works in docker with override but not on host

@dhiltgen can you help me to understand why it works with docker ?

AMD iGPU works in docker with override but not on host

@dhiltgen It's working fine in this setup: * Proxmox running on host machine * Docker running in Debian LXC * Ollama running on docker * Shared GPU **Ollama PS:** ```...

AMD iGPU works in docker with override but not on host

@dhiltgen this is current logs, but I can't spot any difference, any help from you is appreciated 🙏 ON LXC ``` Jun 20 00:11:55 ai-llm ollama[377]: 2024/06/20 00:11:55 routes.go:1008: INFO...

AMD iGPU works in docker with override but not on host

okay chatgpt did a great job 😆 Here are the differences between the two logs: ### Configuration Differences - **LXC Log**: - **OLLAMA_ORIGINS**: `[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:*...

AMD iGPU works in docker with override but not on host

The logs after trying to load the tinyllama on LXC ``` Jun 20 01:00:25 ai-llm ollama[15472]: [GIN] 2024/06/20 - 01:00:25 | 200 | 20.256µs | 127.0.0.1 | HEAD "/" Jun...

AMD iGPU works in docker with override but not on host

So it seems it's trying to do something related to CUDA 🤔 ``` library was not found (discovered GPU libraries paths=[]) cudaSetDevice err: 35 error="your nvidia driver is too old...

AMD iGPU works in docker with override but not on host

@dhiltgen yes I have installed rocm on the lxc machine, it's weird that it behaves differently, is it because lxc based on ubuntu and docker image is based on centos...

AMD iGPU works in docker with override but not on host

I can give it a try to not install rocm, I will share my findings. Regarding the rocm version, on LXC I'm using "6.1.1".

AMD iGPU works in docker with override but not on host

> If you aren't using ROCm for anything else on the host, a potential workaround is uninstall it, but we shouldn't stumble on a ROCm install and fail like this....