Ettore Di Giacinto

we might need to add a specific stanza here, probably dependant from the container runtime to add CAP_KILL (https://unofficial-kubernetes.readthedocs.io/en/latest/concepts/policy/container-capabilities/): ```yaml securityContext: capabilities: add: - KILL ``` To note, I've been...

mmm this is on purpose actually, if a gguf model file is found in the model directory, you should be still able to use it without a config file, as...

For the moment restored the workflow to keep building images here: https://github.com/mudler/LocalAI/pull/7910 https://github.com/mudler/LocalAI/pull/7911. However, `master` images works also with Nvidia GPUs without any issues (I've tested with the DGX Spark)....

opencode example done in https://github.com/mudler/LocalAI/commit/d38811560c957d05e93b94fdcff2b5d313ab9a13

I don't think this is required anymore, closing. If we need it we can re-open it and rebase against master.

I didn't replicated it yet, however I think this could be likely caused from #7769 as from that point we consume vulkan from upstream rather than ubuntu, and the glibc...

Created https://github.com/mudler/LocalAI/pull/7980 to confirm this by reverting to the vulkan-sdk from repositories. However currently we have issues on the CI and most of the backends aren't being published so that...

did some digging: ``` # From vulkan-sdk 1.4.328.1 ❯ objdump -p x86_64/lib/libvulkan.so.1.4.328 | grep "NEEDED.*libc" NEEDED libc.so.6 mudler@mudler-ubuntu-box ~/1.4.328.1 ❯ strings x86_64/lib/libvulkan.so.1.4.328 | grep "^GLIBC_" | sort -V | tail...

Ok, let's start by bumping vulkan before trying to go back to ubuntu repos - the new version looks like its built against GLIBC 2.3*: ``` ❯ strings x86_64/lib/libvulkan.so.1.4.335 |...

new backend images are available now on master, I can't test these now, but if you can check on your side would be great!