Giuseppe Scrivano
Giuseppe Scrivano
> So if I'm hearing you right, we should be shipping /usr/bin/crun-wasm -> crun in Debian -- either in the same "crun" package, or a separate "crun-wasm" package. > >...
I tried reproducing it using a Podman container created with `podman run --privileged -v /root:/root --rm -ti fedora:39 bash ` but in both cases the inner container does not create...
> I tried reproducing it using a Podman container created with `podman run --privileged -v /root:/root --rm -ti fedora:39 bash ` but in both cases the inner container does not...
> I thought the behavior could be related to the cgroup driver, but I obtained the same results (i.e. different device allowed lists) when using runc/crun on a Ubuntu 20.04...
please update your version of systemd, crun doesn't not have the same check in place as runc for the systemd version
> The confusing part for me is that runc has a prompt for the systemd version, but it still executes successfully. On the other hand, crun does not have a...
Wonderful! Thanks! @Luap99 what do you think about it?
@DigitLib you need https://github.com/sroecker/llama.cpp/commit/36dc5bbffe083545045ec2441ddc7f5c085d3caf to load the smaller models
that doesn't seem enough. The model is loaded but it doesn't produce any good result https://github.com/ggerganov/llama.cpp/issues/7116#issuecomment-2100061526
I've managed to get some output that makes some sense with the 3b model, I've opened a PR: - https://github.com/ggerganov/llama.cpp/pull/7481 IMHO it makes sense to define a new architecture for...