mounting "cgroup" to rootfs at "/sys/fs/cgroup" caused: stat no such file or directory

[kycheng]

I use the oci worker of buildkit to build the image, and I encounter the following error, which is an occasional error.

#10 [builder 4/4] RUN go build main.go
#10 0.143 container_linux.go:380: starting container process caused: process_linux.go:545: container init caused: rootfs_linux.go:76: mounting "cgroup" to rootfs at "/sys/fs/cgroup" caused: stat /sys/fs/cgroup/freezer/kubepods-burstable-pode4fa6d79_1abb_4e77_9f6d_4e62ff0d3437.slice:cri-containerd:7c1fc613a2b03bb85b958931fa53a0bfc422cdbde70eaa2b15cbf71485c1c4ec/buildkit/r8wym59fjeuwv89y521xsiqza: no such file or directory
#10 ERROR: process "/bin/sh -c go build main.go" did not complete successfully: exit code: 1
------
 > [builder 4/4] RUN go build main.go:
#10 0.143 container_linux.go:380: starting container process caused: process_linux.go:545: container init caused: rootfs_linux.go:76: mounting "cgroup" to rootfs at "/sys/fs/cgroup" caused: stat /sys/fs/cgroup/freezer/kubepods-burstable-pode4fa6d79_1abb_4e77_9f6d_4e62ff0d3437.slice:cri-containerd:7c1fc613a2b03bb85b958931fa53a0bfc422cdbde70eaa2b15cbf71485c1c4ec/buildkit/r8wym59fjeuwv89y521xsiqza: no such file or directory

version

bash-5.1# buildkit-runc --version
runc version v1.0.2
spec: 1.0.2-dev
go: go1.17.13
libseccomp: 2.5.2

Under what circumstances will this problem occur?

thanks！

[LastNight1997]

Mar 10 10:35:32 ncfa8akursfejjvtn4o5g containerd[5318]: time="2023-03-10T10:35:32.174821423+08:00" level=error msg="StartContainer for \"dde3788ff57334d6d8b62dc6ac2c093ec393dc19649a0c9c60fa08afa9548d67\" failed" error="failed to create containerd task: O CI runtime create failed: runc create failed: unable to start container process: error during container init: error mounting \"cgroup\" to rootfs at \"/sys/fs/cgroup\": stat /run/containerd/io.containerd.runtime.v1.linux/[k8s.io/.d3e77eab91e63b4ff100b72a5](http://k8s.io/.d3e77eab91e63b4ff100b72a5) c623926bf1e4fd0b51a9b58b80082af73a711e9/rootfs/sys/fs/cgroup/dde3788ff57334d6d8b62dc6ac2c093ec393dc19649a0c9c60fa08afa9548d67: no such file or directory: unknown"

same problem in runc 1.1.4 runc version 1.1.4 commit: v1.1.4-0-g5fd4c4d1 spec: 1.0.2-dev go: go1.17.10 libseccomp: 2.5.4

restart machine will recover, but may reproduce the problem after a long time running.

[huangguoqiang]

E0614 18:42:48.074346 6139 remote_runtime.go:253] "StartContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to create containerd task: OCI runtime create failed: container_linux.go:380: starting container process caused: process_linux.go:545: container init caused: rootfs_linux.go:75: mounting "cgroup" to rootfs at "/sys/fs/cgroup" caused: stat /run/k3s/containerd/io.containerd.runtime.v2.task/k8s.io/145e6ce391f6546f8c4ab66ccb7a5c2bce9b0e81503a938e46617728382cc7f4/rootfs/sys/besteffort/pod6ff8f6a3-f9f1-4e3d-9255-8e6590b548c4/14afc6e73be2f93bb2734f3be24865b25742e0086a3181893b34b4ec93c602ee: no such file or directory: unknown" containerID="14afc6e73be2f93bb2734f3be24865b25742e0086a3181893b34b4ec93c602ee"