Sergio López
Sergio López
I'm assuming the goal is to make it work on Linux, isn't it?
It should work with the latest version of libkrun that just landed on Fedora. I'll confirm it tomorrow.
I can confirm this works on Fedora 42 with `libkrun-1.14.0-1.fc42.x86_64` and the latest ramalama container image in quay: ``` podman run --runtime=krun -ti --rm --device /dev/dri -v ~/models:/models quay.io/ramalama/ramalama ```...
> Does `ramalama run --oci-runtime krun --image quay.io/ramalama/ramalama smollm:135m` > > Work? It does! Tested with smollm and deepseek.
> ROCm would require `--device /dev/kfd --device /dev/dri` but I understand it may not be desired to look into ROCm at this point in time. Could be too much effort....
cc/ @sbrivio-rh for awareness
> Maybe an approach similar to https://github.com/AsahiLinux/muvm/pull/111 (tiny DHCP client embedded in muvm) would make sense here as well. That's exactly what I was planning to do, basically by translating...
The problem is that `init` is not translating unicode characters to ascii. Easy to fix. I've created https://github.com/containers/libkrun/issues/382 to track it.
@giuseppe Yes, it should be fixed now.