criu
criu copied to clipboard
Published
20 hours ago •
checkpoint-restore
checkpoint-restore
io_uring support in CRIU
Description
We hit the following error in dumping a process which has an established io_uring queue. It looks like CRIU doesn't support io_uring yet. As the io_uring interface is getting stabilized, do we have any plan to resume the effort in supporting it (here is the past effort: https://github.com/checkpoint-restore/criu/pull/1597)
(00.006990) Error (criu/proc_parse.c:457): Unknown shit f000 600 (anon_inode:[io_uring])
(00.006996) Error (criu/proc_parse.c:685): Can't open 4569's mapfile link 7fc705299000: No such device or address
(00.007003) Error (criu/cr-dump.c:1524): Collect mappings (pid: 4569) failed with -1
Steps to reproduce the issue:
Compile and run the following program:
#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <unistd.h>
#include <fcntl.h>
#include <sys/mman.h>
#include <sys/ioctl.h>
#include <liburing.h>
#define BLOCK_SIZE 4096
int main(int argc, char *argv[]) {
struct io_uring ring;
struct io_uring_sqe *sqe;
struct io_uring_cqe *cqe;
struct iovec iov;
int fd, ret;
char *buffer;
if (argc != 2) {
printf("Usage: %s <filename>\n", argv[0]);
exit(1);
}
fd = open(argv[1], O_RDONLY);
if (fd < 0) {
perror("open");
exit(1);
}
ret = posix_fadvise(fd, 0, 0, POSIX_FADV_SEQUENTIAL);
if (ret < 0) {
perror("posix_fadvise");
exit(1);
}
buffer = mmap(NULL, BLOCK_SIZE, PROT_READ | PROT_WRITE, MAP_PRIVATE | MAP_ANONYMOUS, -1, 0);
if (buffer == MAP_FAILED) {
perror("mmap");
exit(1);
}
ret = io_uring_queue_init(8, &ring, 0);
if (ret < 0) {
perror("io_uring_queue_init");
exit(1);
}
iov.iov_base = buffer;
iov.iov_len = BLOCK_SIZE;
sqe = io_uring_get_sqe(&ring);
io_uring_prep_readv(sqe, fd, &iov, 1, 0);
io_uring_sqe_set_flags(sqe, IOSQE_IO_LINK);
sqe = io_uring_get_sqe(&ring);
io_uring_prep_readv(sqe, fd, &iov, 1, BLOCK_SIZE);
io_uring_sqe_set_flags(sqe, IOSQE_IO_LINK);
ret = io_uring_submit(&ring);
if (ret < 0) {
perror("io_uring_submit");
exit(1);
}
for (;;) {
ret = io_uring_wait_cqe(&ring, &cqe);
if (ret < 0) {
perror("io_uring_wait_cqe");
exit(1);
}
if (cqe->res < 0) {
perror("io_uring");
exit(1);
}
if (cqe->user_data == 0) {
printf("Read first block: %.*s\n", BLOCK_SIZE, buffer);
} else if (cqe->user_data == BLOCK_SIZE) {
printf("Read second block: %.*s\n", BLOCK_SIZE, buffer);
} else {
printf("Unexpected user data: %lu\n", cqe->user_data);
}
io_uring_cqe_seen(&ring, cqe);
if (io_uring_sq_ready(&ring) < 2) {
break;
}
ret = io_uring_submit(&ring);
if (ret < 0) {
perror("io_uring_submit");
exit(1);
}
}
printf("checkpoint now!\n");
sleep(3600);
io_uring_queue_exit(&ring);
munmap(buffer, BLOCK_SIZE);
close(fd);
return 0;
}
sudo criu dump -vvvv -t `pgrep a.out` -D checkpoint --shell-job 2> log
Describe the results you received:
Describe the results you expected:
Additional information you deem important (e.g. issue happens only occasionally):
CRIU logs and information:
CRIU full dump/restore logs:
(00.000004) Version: 3.17 (gitid v3.17-4-g213e1e7f9)
(00.000031) Running on ip-172-31-5-207 Linux 5.15.0-1031-aws #35-Ubuntu SMP Fri Feb 10 02:07:18 UTC 2023 x86_64
(00.000046) Loaded kdat cache from /run/criu.kdat
(00.000066) Hugetlb size 2 Mb is supported but cannot get dev's number
(00.000105) Hugetlb size 1024 Mb is supported but cannot get dev's number
(00.000109) check_options
(00.000112) Will dump/restore TCP connections
(00.000122) ========================================
(00.000125) Dumping processes (pid: 4569)
(00.000128) ========================================
(00.000133) rlimit: RLIMIT_NOFILE unlimited for self
(00.000144) Running pre-dump scripts
(00.000164) irmap: Searching irmap cache in work dir
(00.000176) No irmap-cache image
(00.000181) irmap: Searching irmap cache in parent
(00.000186) No parent images directory provided
(00.000189) irmap: No irmap cache
(00.000202) cpu: x86_family 6 x86_vendor_id GenuineIntel x86_model_id Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz
(00.000208) cpu: fpu: xfeatures_mask 0x5 xsave_size 832 xsave_size_max 832 xsaves_size 0
(00.000212) cpu: fpu: x87 floating point registers xstate_offsets 0 / 0 xstate_sizes 160 / 160
(00.000216) cpu: fpu: AVX registers xstate_offsets 576 / 576 xstate_sizes 256 / 256
(00.000220) cpu: fpu:1 fxsr:1 xsave:1 xsaveopt:1 xsavec:0 xgetbv1:0 xsaves:0
(00.000330) cg-prop: Parsing controller "cpu"
(00.000336) cg-prop: Strategy "replace"
(00.000339) cg-prop: Property "cpu.shares"
(00.000342) cg-prop: Property "cpu.cfs_period_us"
(00.000345) cg-prop: Property "cpu.cfs_quota_us"
(00.000348) cg-prop: Property "cpu.rt_period_us"
(00.000351) cg-prop: Property "cpu.rt_runtime_us"
(00.000353) cg-prop: Parsing controller "memory"
(00.000356) cg-prop: Strategy "replace"
(00.000359) cg-prop: Property "memory.limit_in_bytes"
(00.000362) cg-prop: Property "memory.memsw.limit_in_bytes"
(00.000365) cg-prop: Property "memory.swappiness"
(00.000368) cg-prop: Property "memory.soft_limit_in_bytes"
(00.000371) cg-prop: Property "memory.move_charge_at_immigrate"
(00.000373) cg-prop: Property "memory.oom_control"
(00.000376) cg-prop: Property "memory.use_hierarchy"
(00.000379) cg-prop: Property "memory.kmem.limit_in_bytes"
(00.000382) cg-prop: Property "memory.kmem.tcp.limit_in_bytes"
(00.000385) cg-prop: Parsing controller "cpuset"
(00.000388) cg-prop: Strategy "replace"
(00.000390) cg-prop: Property "cpuset.cpus"
(00.000393) cg-prop: Property "cpuset.mems"
(00.000396) cg-prop: Property "cpuset.memory_migrate"
(00.000399) cg-prop: Property "cpuset.cpu_exclusive"
(00.000402) cg-prop: Property "cpuset.mem_exclusive"
(00.000405) cg-prop: Property "cpuset.mem_hardwall"
(00.000408) cg-prop: Property "cpuset.memory_spread_page"
(00.000410) cg-prop: Property "cpuset.memory_spread_slab"
(00.000413) cg-prop: Property "cpuset.sched_load_balance"
(00.000416) cg-prop: Property "cpuset.sched_relax_domain_level"
(00.000419) cg-prop: Parsing controller "blkio"
(00.000422) cg-prop: Strategy "replace"
(00.000425) cg-prop: Property "blkio.weight"
(00.000427) cg-prop: Parsing controller "freezer"
(00.000430) cg-prop: Strategy "replace"
(00.000433) cg-prop: Parsing controller "perf_event"
(00.000437) cg-prop: Strategy "replace"
(00.000440) cg-prop: Parsing controller "net_cls"
(00.000443) cg-prop: Strategy "replace"
(00.000445) cg-prop: Property "net_cls.classid"
(00.000448) cg-prop: Parsing controller "net_prio"
(00.000451) cg-prop: Strategy "replace"
(00.000458) cg-prop: Property "net_prio.ifpriomap"
(00.000461) cg-prop: Parsing controller "pids"
(00.000464) cg-prop: Strategy "replace"
(00.000467) cg-prop: Property "pids.max"
(00.000470) cg-prop: Parsing controller "devices"
(00.000472) cg-prop: Strategy "replace"
(00.000475) cg-prop: Property "devices.list"
(00.000501) Preparing image inventory (version 1)
(00.000537) Add pid ns 1 pid 4573
(00.000549) Add net ns 2 pid 4573
(00.000559) Add ipc ns 3 pid 4573
(00.000568) Add uts ns 4 pid 4573
(00.000579) Add time ns 5 pid 4573
(00.000594) Add mnt ns 6 pid 4573
(00.000611) Add user ns 7 pid 4573
(00.000620) Add cgroup ns 8 pid 4573
(00.000624) cg: Dumping cgroups for 4573
(00.000640) cg: `- New css ID 1
(00.000643) cg: `- [] -> [/user.slice/user-1000.slice/session-2.scope] [0]
(00.000646) cg: Set 1 is criu one
(00.000660) Detected cgroup V1 freezer
(00.000756) Seized task 4569, state 1
(00.000763) seccomp: Collected tid_real 4569 mode 0
(00.000793) Collected (4 attempts, 0 in_progress)
(00.000816) Collected (4 attempts, 0 in_progress)
(00.000825) Collected 4569 in 1 state
(00.000891) Lock network
(00.000955) type ext4 source /dev/root mnt_id 24 s_dev 0xca00001 / @ ./ flags 0x300000 options discard,errors=remount-ro
(00.000967) type devtmpfs source devtmpfs mnt_id 25 s_dev 0x5 / @ ./dev flags 0x300000 options size=31371184k,nr_inodes=7842796,mode=755,inode64
(00.000974) type proc source proc mnt_id 26 s_dev 0x16 / @ ./proc flags 0x30000e options
(00.000980) type sysfs source sysfs mnt_id 27 s_dev 0x17 / @ ./sys flags 0x30000e options
(00.000986) type securityfs source securityfs mnt_id 28 s_dev 0x6 / @ ./sys/kernel/security flags 0x30000e options
(00.000997) type tmpfs source tmpfs mnt_id 29 s_dev 0x18 / @ ./dev/shm flags 0x1100006 options inode64
(00.001007) type devpts source devpts mnt_id 30 s_dev 0x19 / @ ./dev/pts flags 0x30000a options gid=5,mode=620,ptmxmode=000
(00.001019) type tmpfs source tmpfs mnt_id 31 s_dev 0x1a / @ ./run flags 0x1100006 options size=12551572k,nr_inodes=819200,mode=755,inode64
(00.001025) type tmpfs source tmpfs mnt_id 32 s_dev 0x1b / @ ./run/lock flags 0x30000e options size=5120k,inode64
(00.001032) type cgroup2 source cgroup2 mnt_id 33 s_dev 0x1c / @ ./sys/fs/cgroup flags 0x30000e options nsdelegate,memory_recursiveprot
(00.001067) type pstore source pstore mnt_id 34 s_dev 0x1d / @ ./sys/fs/pstore flags 0x30000e options
(00.001073) type bpf source bpf mnt_id 35 s_dev 0x1e / @ ./sys/fs/bpf flags 0x30000e options mode=700
(00.001081) type autofs source systemd-1 mnt_id 36 s_dev 0x1f / @ ./proc/sys/fs/binfmt_misc flags 0x300000 options fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16863
(00.001092) type hugetlbfs source hugetlbfs mnt_id 37 s_dev 0x20 / @ ./dev/hugepages flags 0x300000 options pagesize=2M
(00.001098) type mqueue source mqueue mnt_id 38 s_dev 0x14 / @ ./dev/mqueue flags 0x30000e options
(00.001103) type debugfs source debugfs mnt_id 39 s_dev 0x7 / @ ./sys/kernel/debug flags 0x30000e options
(00.001109) type tracefs source tracefs mnt_id 40 s_dev 0xc / @ ./sys/kernel/tracing flags 0x30000e options
(00.001112) skipping fs mounted at /sys/kernel/tracing
(00.001119) type fusectl source fusectl mnt_id 41 s_dev 0x21 / @ ./sys/fs/fuse/connections flags 0x30000e options
(00.001125) type configfs source configfs mnt_id 42 s_dev 0x15 / @ ./sys/kernel/config flags 0x30000e options
(00.001133) type ramfs source none mnt_id 64 s_dev 0x22 / @ ./run/credentials/systemd-sysusers.service flags 0x30000f options mode=700
(00.001164) type squashfs source /dev/loop0 mnt_id 88 s_dev 0x700000 / @ ./snap/amazon-ssm-agent/6312 flags 0x300005 options errors=continue
(00.001171) type squashfs source /dev/loop1 mnt_id 91 s_dev 0x700001 / @ ./snap/core18/2708 flags 0x300005 options errors=continue
(00.001176) type squashfs source /dev/loop2 mnt_id 94 s_dev 0x700002 / @ ./snap/core18/2714 flags 0x300005 options errors=continue
(00.001182) type squashfs source /dev/loop3 mnt_id 97 s_dev 0x700003 / @ ./snap/core20/1822 flags 0x300005 options errors=continue
(00.001188) type squashfs source /dev/loop4 mnt_id 100 s_dev 0x700004 / @ ./snap/core20/1828 flags 0x300005 options errors=continue
(00.001194) type squashfs source /dev/loop5 mnt_id 103 s_dev 0x700005 / @ ./snap/lxd/24322 flags 0x300005 options errors=continue
(00.001200) type squashfs source /dev/loop6 mnt_id 106 s_dev 0x700006 / @ ./snap/snapd/17950 flags 0x300005 options errors=continue
(00.001209) type squashfs source /dev/loop7 mnt_id 109 s_dev 0x700007 / @ ./snap/snapd/18357 flags 0x300005 options errors=continue
(00.001217) type vfat source /dev/xvda15 mnt_id 112 s_dev 0xca0000f / @ ./boot/efi flags 0x300000 options fmask=0077,dmask=0077,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro
(00.001229) type binfmt_misc source binfmt_misc mnt_id 115 s_dev 0x23 / @ ./proc/sys/fs/binfmt_misc flags 0x30000e options
(00.001243) type tmpfs source tmpfs mnt_id 507 s_dev 0x1a /snapd/ns @ ./run/snapd/ns flags 0x1000006 options size=12551572k,nr_inodes=819200,mode=755,inode64
(00.001250) type nsfs source nsfs mnt_id 557 s_dev 0x4 mnt:[4026532845] @ ./run/snapd/ns/lxd.mnt flags 0x1000000 options
(00.001258) type tmpfs source tmpfs mnt_id 474 s_dev 0x29 / @ ./run/user/1000 flags 0x300006 options size=6275784k,nr_inodes=1568946,mode=700,uid=1000,gid=1000,inode64
(00.001265) mnt: Building mountpoints tree
(00.001268) mnt: Building plain mount tree
(00.001271) mnt: Working on 474->31
(00.001275) mnt: Working on 557->507
(00.001277) mnt: Working on 507->31
(00.001280) mnt: Working on 115->36
(00.001283) mnt: Working on 112->24
(00.001286) mnt: Working on 109->24
(00.001289) mnt: Working on 106->24
(00.001291) mnt: Working on 103->24
(00.001294) mnt: Working on 100->24
(00.001297) mnt: Working on 97->24
(00.001300) mnt: Working on 94->24
(00.001302) mnt: Working on 91->24
(00.001305) mnt: Working on 88->24
(00.001308) mnt: Working on 64->31
(00.001310) mnt: Working on 42->27
(00.001313) mnt: Working on 41->27
(00.001316) mnt: Working on 39->27
(00.001319) mnt: Working on 38->25
(00.001321) mnt: Working on 37->25
(00.001324) mnt: Working on 36->26
(00.001327) mnt: Working on 35->27
(00.001330) mnt: Working on 34->27
(00.001332) mnt: Working on 33->27
(00.001335) mnt: Working on 32->31
(00.001338) mnt: Working on 31->24
(00.001341) mnt: Working on 30->25
(00.001343) mnt: Working on 29->25
(00.001346) mnt: Working on 28->27
(00.001349) mnt: Working on 27->24
(00.001352) mnt: Working on 26->24
(00.001354) mnt: Working on 25->24
(00.001357) mnt: Working on 24->1
(00.001360) mnt: Resorting children of 24 in mount order
(00.001365) mnt: Resorting children of 109 in mount order
(00.001368) mnt: Resorting children of 106 in mount order
(00.001370) mnt: Resorting children of 103 in mount order
(00.001373) mnt: Resorting children of 100 in mount order
(00.001376) mnt: Resorting children of 97 in mount order
(00.001378) mnt: Resorting children of 94 in mount order
(00.001381) mnt: Resorting children of 91 in mount order
(00.001384) mnt: Resorting children of 88 in mount order
(00.001386) mnt: Resorting children of 112 in mount order
(00.001389) mnt: Resorting children of 31 in mount order
(00.001392) mnt: Resorting children of 474 in mount order
(00.001395) mnt: Resorting children of 507 in mount order
(00.001397) mnt: Resorting children of 557 in mount order
(00.001400) mnt: Resorting children of 64 in mount order
(00.001403) mnt: Resorting children of 32 in mount order
(00.001405) mnt: Resorting children of 27 in mount order
(00.001409) mnt: Resorting children of 41 in mount order
(00.001411) mnt: Resorting children of 42 in mount order
(00.001414) mnt: Resorting children of 39 in mount order
(00.001417) mnt: Resorting children of 35 in mount order
(00.001419) mnt: Resorting children of 34 in mount order
(00.001422) mnt: Resorting children of 33 in mount order
(00.001424) mnt: Resorting children of 28 in mount order
(00.001427) mnt: Resorting children of 26 in mount order
(00.001430) mnt: Resorting children of 36 in mount order
(00.001433) mnt: Resorting children of 115 in mount order
(00.001435) mnt: Resorting children of 25 in mount order
(00.001438) mnt: Resorting children of 38 in mount order
(00.001441) mnt: Resorting children of 37 in mount order
(00.001443) mnt: Resorting children of 30 in mount order
(00.001446) mnt: Resorting children of 29 in mount order
(00.001449) mnt: Done:
(00.001451) mnt: [./](24->1)
(00.001455) mnt: [./snap/snapd/18357](109->24)
(00.001458) mnt: <--
(00.001460) mnt: [./snap/snapd/17950](106->24)
(00.001463) mnt: <--
(00.001466) mnt: [./snap/lxd/24322](103->24)
(00.001473) mnt: <--
(00.001475) mnt: [./snap/core20/1828](100->24)
(00.001478) mnt: <--
(00.001481) mnt: [./snap/core20/1822](97->24)
(00.001484) mnt: <--
(00.001486) mnt: [./snap/core18/2714](94->24)
(00.001489) mnt: <--
(00.001492) mnt: [./snap/core18/2708](91->24)
(00.001494) mnt: <--
(00.001497) mnt: [./snap/amazon-ssm-agent/6312](88->24)
(00.001500) mnt: <--
(00.001503) mnt: [./boot/efi](112->24)
(00.001506) mnt: <--
(00.001508) mnt: [./run](31->24)
(00.001511) mnt: [./run/user/1000](474->31)
(00.001514) mnt: <--
(00.001517) mnt: [./run/snapd/ns](507->31)
(00.001519) mnt: [./run/snapd/ns/lxd.mnt](557->507)
(00.001522) mnt: <--
(00.001525) mnt: <--
(00.001528) mnt: [./run/credentials/systemd-sysusers.service](64->31)
(00.001531) mnt: <--
(00.001533) mnt: [./run/lock](32->31)
(00.001536) mnt: <--
(00.001539) mnt: <--
(00.001541) mnt: [./sys](27->24)
(00.001544) mnt: [./sys/fs/fuse/connections](41->27)
(00.001547) mnt: <--
(00.001550) mnt: [./sys/kernel/config](42->27)
(00.001553) mnt: <--
(00.001555) mnt: [./sys/kernel/debug](39->27)
(00.001558) mnt: <--
(00.001561) mnt: [./sys/fs/bpf](35->27)
(00.001563) mnt: <--
(00.001566) mnt: [./sys/fs/pstore](34->27)
(00.001569) mnt: <--
(00.001572) mnt: [./sys/fs/cgroup](33->27)
(00.001574) mnt: <--
(00.001577) mnt: [./sys/kernel/security](28->27)
(00.001580) mnt: <--
(00.001582) mnt: <--
(00.001585) mnt: [./proc](26->24)
(00.001588) mnt: [./proc/sys/fs/binfmt_misc](36->26)
(00.001591) mnt: [./proc/sys/fs/binfmt_misc](115->36)
(00.001594) mnt: <--
(00.001596) mnt: <--
(00.001599) mnt: <--
(00.001602) mnt: [./dev](25->24)
(00.001604) mnt: [./dev/mqueue](38->25)
(00.001607) mnt: <--
(00.001610) mnt: [./dev/hugepages](37->25)
(00.001613) mnt: <--
(00.001615) mnt: [./dev/pts](30->25)
(00.001618) mnt: <--
(00.001621) mnt: [./dev/shm](29->25)
(00.001624) mnt: <--
(00.001626) mnt: <--
(00.001629) mnt: <--
(00.001638) mnt: The mount 31 is bind for 507 (@./run -> @./run/snapd/ns)
(00.001650) Collecting netns 2/4573
(00.001823) unix: Collected: ino 13052 peer_ino 0 family 1 type 1 state 10 name /var/snap/lxd/common/lxd/unix.socket
(00.001830) unix: Collected: ino 13054 peer_ino 0 family 1 type 1 state 10 name /var/snap/lxd/common/lxd-user/unix.socket
(00.001834) unix: Collected: ino 20294 peer_ino 0 family 1 type 2 state 7 name /run/user/1000/systemd/notify
(00.001837) unix: Collected: ino 20297 peer_ino 0 family 1 type 1 state 10 name /run/user/1000/systemd/private
(00.001840) unix: Collected: ino 20303 peer_ino 0 family 1 type 1 state 10 name /run/user/1000/bus
(00.001844) unix: Collected: ino 16868 peer_ino 0 family 1 type 1 state 10 name
(00.001847) unix: Collected: ino 20305 peer_ino 0 family 1 type 1 state 10 name /run/user/1000/gnupg/S.dirmngr
(00.001850) unix: Collected: ino 20307 peer_ino 0 family 1 type 1 state 10 name /run/user/1000/gnupg/S.gpg-agent.browser
(00.001854) unix: Collected: ino 20309 peer_ino 0 family 1 type 1 state 10 name /run/user/1000/gnupg/S.gpg-agent.extra
(00.001857) unix: Collected: ino 20311 peer_ino 0 family 1 type 1 state 10 name /run/user/1000/gnupg/S.gpg-agent.ssh
(00.001860) unix: Collected: ino 20313 peer_ino 0 family 1 type 1 state 10 name /run/user/1000/gnupg/S.gpg-agent
(00.001863) unix: Collected: ino 20315 peer_ino 0 family 1 type 1 state 10 name /run/user/1000/pk-debconf-socket
(00.001866) unix: Collected: ino 20317 peer_ino 0 family 1 type 1 state 10 name /run/user/1000/snapd-session-agent.socket
(00.001870) unix: Collected: ino 23004 peer_ino 0 family 1 type 1 state 10 name /tmp/tmux-1000/default
(00.001873) unix: Collected: ino 16852 peer_ino 0 family 1 type 2 state 1 name /run/systemd/notify
(00.001876) unix: Collected: ino 16855 peer_ino 0 family 1 type 1 state 10 name /run/systemd/private
(00.001880) unix: Collected: ino 16857 peer_ino 0 family 1 type 1 state 10 name /run/systemd/userdb/io.systemd.DynamicUser
(00.001888) unix: Collected: ino 16858 peer_ino 0 family 1 type 1 state 10 name /run/systemd/io.system.ManagedOOM
(00.001891) unix: Collected: ino 17403 peer_ino 0 family 1 type 1 state 10 name /var/lib/amazon/ssm/ipc/health
(00.001895) unix: Collected: ino 16866 peer_ino 0 family 1 type 1 state 10 name /run/lvm/lvmpolld.socket
(00.001898) unix: Collected: ino 16869 peer_ino 0 family 1 type 2 state 7 name /run/systemd/journal/syslog
(00.001901) unix: Collected: ino 16871 peer_ino 0 family 1 type 1 state 10 name /run/systemd/fsck.progress
(00.001908) unix: Collected: ino 16879 peer_ino 0 family 1 type 2 state 1 name /run/systemd/journal/dev-log
(00.001911) unix: Collected: ino 16881 peer_ino 0 family 1 type 2 state 1 name /run/systemd/journal/socket
(00.001914) unix: Collected: ino 16883 peer_ino 0 family 1 type 1 state 10 name /run/systemd/journal/stdout
(00.001918) unix: Collected: ino 16886 peer_ino 0 family 1 type 5 state 10 name /run/udev/control
(00.001921) unix: Collected: ino 12695 peer_ino 0 family 1 type 1 state 10 name /run/systemd/journal/io.systemd.journal
(00.001924) unix: Collected: ino 17404 peer_ino 0 family 1 type 1 state 10 name /var/lib/amazon/ssm/ipc/termination
(00.001928) unix: Collected: ino 18716 peer_ino 0 family 1 type 1 state 10 name /run/systemd/resolve/io.systemd.Resolve
(00.001931) unix: Collected: ino 13047 peer_ino 0 family 1 type 1 state 10 name /run/acpid.socket
(00.001934) unix: Collected: ino 13049 peer_ino 0 family 1 type 1 state 10 name /run/dbus/system_bus_socket
(00.001938) unix: Collected: ino 13056 peer_ino 0 family 1 type 1 state 10 name /run/snapd.socket
(00.001941) unix: Collected: ino 13058 peer_ino 0 family 1 type 1 state 10 name /run/snapd-snap.socket
(00.001944) unix: Collected: ino 13060 peer_ino 0 family 1 type 1 state 10 name /run/uuidd/request
(00.001947) unix: Collected: ino 18823 peer_ino 0 family 1 type 1 state 10 name /run/irqbalance/irqbalance549.sock
(00.001950) unix: Collected: ino 18827 peer_ino 0 family 1 type 2 state 1 name /run/chrony/chronyd.sock
(00.001962) unix: Collected: ino 13051 peer_ino 0 family 1 type 1 state 10 name
(00.001966) unix: Collected: ino 17371 peer_ino 0 family 1 type 1 state 10 name /run/containerd/containerd.sock.ttrpc
(00.001969) unix: Collected: ino 17373 peer_ino 0 family 1 type 1 state 10 name /run/containerd/containerd.sock
(00.001972) unix: Collected: ino 18706 peer_ino 16881 family 1 type 2 state 1 name null
(00.001976) unix: Collected: ino 19816 peer_ino 17810 family 1 type 1 state 1 name null
(00.001979) unix: Collected: ino 17979 peer_ino 16879 family 1 type 2 state 1 name null
(00.001982) unix: Collected: ino 16058 peer_ino 18891 family 1 type 1 state 1 name null
(00.001985) unix: Collected: ino 18893 peer_ino 14019 family 1 type 1 state 1 name /run/dbus/system_bus_socket
(00.001989) unix: Collected: ino 24836 peer_ino 24835 family 1 type 1 state 1 name null
(00.001992) unix: Collected: ino 17764 peer_ino 18765 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.001997) unix: Collected: ino 16053 peer_ino 20925 family 1 type 1 state 1 name null
(00.002001) unix: Collected: ino 17810 peer_ino 19816 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002004) unix: Collected: ino 21034 peer_ino 16879 family 1 type 2 state 1 name null
(00.002007) unix: Collected: ino 15968 peer_ino 16879 family 1 type 2 state 1 name null
(00.002010) unix: Collected: ino 16854 peer_ino 16853 family 1 type 2 state 1 name null
(00.002013) unix: Collected: ino 18692 peer_ino 13841 family 1 type 1 state 1 name null
(00.002017) unix: Collected: ino 22571 peer_ino 20299 family 1 type 1 state 1 name /run/dbus/system_bus_socket
(00.002020) unix: Collected: ino 19806 peer_ino 19774 family 1 type 1 state 1 name /run/dbus/system_bus_socket
(00.002023) unix: Collected: ino 13809 peer_ino 16881 family 1 type 2 state 1 name null
(00.002030) unix: Collected: ino 20513 peer_ino 16881 family 1 type 2 state 1 name null
(00.002033) unix: Collected: ino 17243 peer_ino 17242 family 1 type 1 state 1 name /run/dbus/system_bus_socket
(00.002036) unix: Collected: ino 17197 peer_ino 16879 family 1 type 2 state 1 name null
(00.002040) unix: Collected: ino 14019 peer_ino 18893 family 1 type 1 state 1 name null
(00.002043) unix: Collected: ino 18891 peer_ino 16058 family 1 type 1 state 1 name /run/dbus/system_bus_socket
(00.002046) unix: Collected: ino 20477 peer_ino 22750 family 1 type 1 state 1 name null
(00.002049) unix: Collected: ino 21669 peer_ino 19895 family 1 type 1 state 1 name null
(00.002052) unix: Collected: ino 16062 peer_ino 16061 family 1 type 1 state 1 name null
(00.002056) unix: Collected: ino 15975 peer_ino 17807 family 1 type 1 state 1 name null
(00.002059) unix: Collected: ino 29437 peer_ino 0 family 1 type 5 state 7 name null
(00.002062) unix: Collected: ino 19088 peer_ino 18104 family 1 type 1 state 1 name null
(00.002065) unix: Collected: ino 19793 peer_ino 17777 family 1 type 1 state 1 name null
(00.002068) unix: Collected: ino 35855 peer_ino 0 family 1 type 2 state 7 name null
(00.002071) unix: Collected: ino 31994 peer_ino 16879 family 1 type 2 state 1 name null
(00.002079) unix: Collected: ino 20280 peer_ino 16881 family 1 type 2 state 1 name null
(00.002082) unix: Collected: ino 17807 peer_ino 15975 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002085) unix: Collected: ino 15958 peer_ino 19807 family 1 type 1 state 1 name null
(00.002088) unix: Collected: ino 19774 peer_ino 19806 family 1 type 1 state 1 name null
(00.002092) unix: Collected: ino 13817 peer_ino 13818 family 1 type 2 state 1 name null
(00.002095) unix: Collected: ino 17217 peer_ino 16879 family 1 type 2 state 1 name null
(00.002098) unix: Collected: ino 18104 peer_ino 19088 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002101) unix: Collected: ino 20299 peer_ino 22571 family 1 type 1 state 1 name null
(00.002104) unix: Collected: ino 20925 peer_ino 16053 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002108) unix: Collected: ino 18772 peer_ino 18768 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002111) unix: Collected: ino 19803 peer_ino 16879 family 1 type 2 state 1 name null
(00.002114) unix: Collected: ino 12784 peer_ino 12785 family 1 type 2 state 1 name null
(00.002117) unix: Collected: ino 12699 peer_ino 16852 family 1 type 2 state 1 name null
(00.002120) unix: Collected: ino 20870 peer_ino 16881 family 1 type 2 state 1 name null
(00.002123) unix: Collected: ino 17242 peer_ino 17243 family 1 type 1 state 1 name null
(00.002127) unix: Collected: ino 18853 peer_ino 17244 family 1 type 1 state 1 name null
(00.002130) unix: Collected: ino 13815 peer_ino 13816 family 1 type 2 state 1 name null
(00.002133) unix: Collected: ino 17244 peer_ino 18853 family 1 type 1 state 1 name /run/dbus/system_bus_socket
(00.002136) unix: Collected: ino 19808 peer_ino 13076 family 1 type 1 state 1 name /run/dbus/system_bus_socket
(00.002139) unix: Collected: ino 31996 peer_ino 31995 family 1 type 1 state 1 name null
(00.002143) unix: Collected: ino 14155 peer_ino 17969 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002146) unix: Collected: ino 17808 peer_ino 15979 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002149) unix: Collected: ino 19807 peer_ino 15958 family 1 type 1 state 1 name /run/dbus/system_bus_socket
(00.002155) unix: Collected: ino 21697 peer_ino 17915 family 1 type 1 state 1 name /var/lib/amazon/ssm/ipc/termination
(00.002158) unix: Collected: ino 17210 peer_ino 13950 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002165) unix: Collected: ino 17777 peer_ino 19793 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002168) unix: Collected: ino 19781 peer_ino 16879 family 1 type 2 state 1 name null
(00.002171) unix: Collected: ino 19537 peer_ino 16971 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002174) unix: Collected: ino 13818 peer_ino 13817 family 1 type 2 state 1 name null
(00.002177) unix: Collected: ino 20295 peer_ino 20296 family 1 type 2 state 1 name null
(00.002181) unix: Collected: ino 17937 peer_ino 0 family 1 type 1 state 1 name null
(00.002184) unix: Collected: ino 16061 peer_ino 16062 family 1 type 1 state 1 name null
(00.002187) unix: Collected: ino 22750 peer_ino 20477 family 1 type 1 state 1 name /run/dbus/system_bus_socket
(00.002190) unix: Collected: ino 17915 peer_ino 21697 family 1 type 1 state 1 name null
(00.002193) unix: Collected: ino 13841 peer_ino 18692 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002197) unix: Collected: ino 19855 peer_ino 19854 family 1 type 1 state 1 name null
(00.002200) unix: Collected: ino 19547 peer_ino 12771 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002203) unix: Collected: ino 20950 peer_ino 14049 family 1 type 1 state 1 name null
(00.002234) unix: Collected: ino 16853 peer_ino 16854 family 1 type 2 state 1 name null
(00.002237) unix: Collected: ino 19091 peer_ino 16879 family 1 type 2 state 1 name null
(00.002240) unix: Collected: ino 18022 peer_ino 18021 family 1 type 1 state 1 name null
(00.002244) unix: Collected: ino 12771 peer_ino 19547 family 1 type 1 state 1 name null
(00.002247) unix: Collected: ino 19854 peer_ino 19855 family 1 type 1 state 1 name null
(00.002250) unix: Collected: ino 19811 peer_ino 20837 family 1 type 1 state 1 name null
(00.002253) unix: Collected: ino 19805 peer_ino 19804 family 1 type 1 state 1 name null
(00.002256) unix: Collected: ino 13795 peer_ino 18677 family 1 type 1 state 1 name null
(00.002263) unix: Collected: ino 18829 peer_ino 18828 family 1 type 5 state 1 name null
(00.002266) unix: Collected: ino 20993 peer_ino 17916 family 1 type 1 state 1 name null
(00.002269) unix: Collected: ino 12785 peer_ino 12784 family 1 type 2 state 1 name null
(00.002272) unix: Collected: ino 18677 peer_ino 13795 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002276) unix: Collected: ino 17916 peer_ino 20993 family 1 type 1 state 1 name /var/lib/amazon/ssm/ipc/health
(00.002279) unix: Collected: ino 14049 peer_ino 20950 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002282) unix: Collected: ino 13076 peer_ino 19808 family 1 type 1 state 1 name null
(00.002285) unix: Collected: ino 18765 peer_ino 17764 family 1 type 1 state 1 name null
(00.002288) unix: Collected: ino 17969 peer_ino 14155 family 1 type 1 state 1 name null
(00.002292) unix: Collected: ino 18828 peer_ino 18829 family 1 type 5 state 1 name null
(00.002295) unix: Collected: ino 19895 peer_ino 21669 family 1 type 1 state 1 name /run/dbus/system_bus_socket
(00.002298) unix: Collected: ino 20296 peer_ino 20295 family 1 type 2 state 1 name null
(00.002301) unix: Collected: ino 13950 peer_ino 17210 family 1 type 1 state 1 name null
(00.002304) unix: Collected: ino 31995 peer_ino 31996 family 1 type 1 state 1 name null
(00.002307) unix: Collected: ino 12780 peer_ino 16881 family 1 type 2 state 1 name null
(00.002311) unix: Collected: ino 20837 peer_ino 19811 family 1 type 1 state 1 name /run/systemd/journal/stdout
(00.002314) unix: Collected: ino 15979 peer_ino 17808 family 1 type 1 state 1 name null
(00.002317) unix: Collected: ino 18021 peer_ino 18022 family 1 type 1 state 1 name null
(00.002320) unix: Collected: ino 13816 peer_ino 13815 family 1 type 2 state 1 name null
(00.002327) unix: Collected: ino 16971 peer_ino 19537 family 1 type 1 state 1 name null
(00.002330) unix: Collected: ino 18768 peer_ino 18772 family 1 type 1 state 1 name null
(00.002334) unix: Collected: ino 24835 peer_ino 24836 family 1 type 1 state 1 name null
(00.002337) unix: Collected: ino 19804 peer_ino 19805 family 1 type 1 state 1 name null
(00.003878) inet: Collected: ino 0x51d0 family AF_INET type SOCK_STREAM port 38425 state TCP_LISTEN src_addr 127.0.0.1
(00.003888) inet: Collected: ino 0x491b family AF_INET type SOCK_STREAM port 53 state TCP_LISTEN src_addr 127.0.0.53
(00.003892) inet: Collected: ino 0x51df family AF_INET type SOCK_STREAM port 22 state TCP_LISTEN src_addr 0.0.0.0
(00.003895) inet: Collected: ino 0x5209 family AF_INET type SOCK_STREAM port 22 state TCP_ESTABLISHED src_addr 172.31.5.207
(00.004019) inet: Collected: ino 0x491a family AF_INET type SOCK_DGRAM port 53 state TCP_CLOSE src_addr 127.0.0.53
(00.004024) inet: Collected: ino 0x62b7 family AF_INET type SOCK_DGRAM port 68 state TCP_CLOSE src_addr 172.31.5.207
(00.004028) inet: Collected: ino 0x3e65 family AF_INET type SOCK_DGRAM port 323 state TCP_CLOSE src_addr 127.0.0.1
(00.005640) inet: Collected: ino 0x51e1 family AF_INET6 type SOCK_STREAM port 22 state TCP_LISTEN src_addr ::
(00.005754) inet: Collected: ino 0x3e66 family AF_INET6 type SOCK_DGRAM port 323 state TCP_CLOSE src_addr ::1
(00.005872) inet: Collected: ino 0x32ed family AF_INET6 type SOCK_RAW port 58 state TCP_CLOSE src_addr ::
(00.005889) packet: Collect packet sock 13840 35020
(00.005893) packet: Got 3 mreqs
(00.005937) netlink: Collect netlink sock 0x4a96
(00.005941) netlink: Collect netlink sock 0x41f5
(00.005944) netlink: Collect netlink sock 0x4917
(00.005947) netlink: Collect netlink sock 0x11
(00.005950) netlink: Collect netlink sock 0x4a96
(00.005953) netlink: Collect netlink sock 0x4917
(00.005955) netlink: Collect netlink sock 0x41f5
(00.005958) netlink: Collect netlink sock 0x72fc
(00.005961) netlink: Collect netlink sock 0x3406
(00.005964) netlink: Collect netlink sock 0x3839
(00.005966) netlink: Collect netlink sock 0x7cf7
(00.005970) netlink: Collect netlink sock 0x5022
(00.005973) netlink: Collect netlink sock 0x17
(00.005975) netlink: Collect netlink sock 0x41ee
(00.005978) netlink: Collect netlink sock 0x41ee
(00.005981) netlink: Collect netlink sock 0x3401
(00.005983) netlink: Collect netlink sock 0x23
(00.005986) netlink: Collect netlink sock 0x6780
(00.005989) netlink: Collect netlink sock 0x35f6
(00.005992) netlink: Collect netlink sock 0x4f2e
(00.005995) netlink: Collect netlink sock 0x49a4
(00.005998) netlink: Collect netlink sock 0x4f44
(00.006000) netlink: Collect netlink sock 0x49a3
(00.006003) netlink: Collect netlink sock 0x41f8
(00.006006) netlink: Collect netlink sock 0x41d3
(00.006008) netlink: Collect netlink sock 0x44d9
(00.006011) netlink: Collect netlink sock 0x19
(00.006014) netlink: Collect netlink sock 0x49a1
(00.006017) netlink: Collect netlink sock 0x49a2
(00.006020) netlink: Collect netlink sock 0x4f44
(00.006022) netlink: Collect netlink sock 0x4f2e
(00.006025) netlink: Collect netlink sock 0x49a4
(00.006028) netlink: Collect netlink sock 0x49a3
(00.006031) netlink: Collect netlink sock 0x49a2
(00.006033) netlink: Collect netlink sock 0x49a1
(00.006036) netlink: Collect netlink sock 0x35f6
(00.006039) netlink: Collect netlink sock 0x44d9
(00.006042) netlink: Collect netlink sock 0x41f8
(00.006045) netlink: Collect netlink sock 0x41d3
(00.006047) netlink: Collect netlink sock 0x12
(00.006050) netlink: Collect netlink sock 0x3e5f
(00.006053) netlink: Collect netlink sock 0x35f5
(00.006056) netlink: Collect netlink sock 0x3e5f
(00.006059) netlink: Collect netlink sock 0x26
(00.006073) Collecting pidns 1/4573
(00.006155) No parent images directory provided
(00.006286) rmrf: removing .criu.temp-aa-policy.21ev9Y
(00.006353) ========================================
(00.006357) Dumping task (pid: 4569)
(00.006360) ========================================
(00.006363) Obtaining task stat ...
(00.006397)
(00.006401) Collecting mappings (pid: 4569)
(00.006404) ----------------------------------------
(00.006475) Found regular file mapping, OK
(00.006528) Dumping path for -3 fd via self 12 [/home/ubuntu/a.out]
(00.006612) vma 5596e276d000 borrows vfi from previous 5596e276c000
(00.006624) vma 5596e276e000 borrows vfi from previous 5596e276d000
(00.006633) vma 5596e276f000 borrows vfi from previous 5596e276e000
(00.006641) vma 5596e2770000 borrows vfi from previous 5596e276f000
(00.006713) Found regular file mapping, OK
(00.006744) Dumping path for -3 fd via self 12 [/usr/lib/x86_64-linux-gnu/libc.so.6]
(00.006792) vma 7fc70508e000 borrows vfi from previous 7fc705066000
(00.006803) vma 7fc705223000 borrows vfi from previous 7fc70508e000
(00.006812) vma 7fc70527b000 borrows vfi from previous 7fc705223000
(00.006820) vma 7fc70527f000 borrows vfi from previous 7fc70527b000
(00.006865) Found regular file mapping, OK
(00.006887) Dumping path for -3 fd via self 12 [/usr/lib/x86_64-linux-gnu/liburing.so.2.1.0]
(00.006924) vma 7fc705290000 borrows vfi from previous 7fc70528e000
(00.006934) vma 7fc705292000 borrows vfi from previous 7fc705290000
(00.006942) vma 7fc705293000 borrows vfi from previous 7fc705292000
(00.006950) vma 7fc705294000 borrows vfi from previous 7fc705293000
(00.006990) Error (criu/proc_parse.c:457): Unknown shit f000 600 (anon_inode:[io_uring])
(00.006996) Error (criu/proc_parse.c:685): Can't open 4569's mapfile link 7fc705299000: No such device or address
(00.007003) Error (criu/cr-dump.c:1524): Collect mappings (pid: 4569) failed with -1
(00.007154) Unlock network
(00.007162) Unfreezing tasks into 1
(00.007165) Unseizing 4569 into 1
(00.007182) Error (criu/cr-dump.c:2053): Dumping FAILED.
Output of `criu --version`:
ubuntu@ip-172-31-5-207:~$ criu --version
Version: 3.17
GitID: v3.17-4-g213e1e7f9
Output of `criu check --all`:
ubuntu@ip-172-31-5-207:~$ sudo criu check --all
sudo: mon_handle_sigchld: waitpid: No child processes
Looks good.
Additional environment details:
ubuntu@ip-172-31-5-207:~$ cat /proc/version
Linux version 5.15.0-1031-aws (buildd@lcy02-amd64-016) (gcc (Ubuntu 11.3.0-1ubuntu1~22.04) 11.3.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #35-Ubuntu SMP Fri Feb 10 02:07:18 UTC 2023
Currently we have no resources to work on that. But this project is in our ToDo :) Kumar did a great job on that, but we need someone to continue push that project.
Currently we have no resources to work on that. But this project is in our ToDo :) Kumar did a great job on that, but we need someone to continue push that project.
Good to know it's on the TODO list :). Is there any link/doc that will be used to track the effort (and avoid duplicated efforts)?
Currently we have no resources to work on that. But this project is in our ToDo :) Kumar did a great job on that, but we need someone to continue push that project.
Good to know it's on the TODO list :). Is there any link/doc that will be used to track the effort (and avoid duplicated efforts)?
I think this issue that you have created will serve in that role ;-)
Currently we have no resources to work on that. But this project is in our ToDo :) Kumar did a great job on that, but we need someone to continue push that project.
Hello @mihalicyn
One possible way is to pause or terminate the process's io_uring operations before attempting to dump it with CRIU. This could potentially allow CRIU to dump the process's state without encountering the io_uring-related errors. However, this would depend on the specific details of the application and its use of io_uring, and may not be feasible in all cases.
if possible, can i work on this project?
One possible way is to pause or terminate the process's io_uring operations before attempting to dump it with CRIU. This could potentially allow CRIU to dump the process's state without encountering the io_uring-related errors. However, this would depend on the specific details of the application and its use of io_uring, and may not be feasible in all cases.
no, because you process will still hold a references to io_uring (through file descriptors and memory areas).
if possible, can i work on this project?
I'm not sure what you asking, but anyone is welcome to work on CRIU. :-)
If you question is GSoC related, then no, we haven't published this project this year: https://criu.org/Google_Summer_of_Code https://criu.org/Google_Summer_of_Code_Ideas
Kumar did a great job (https://github.com/kkdwivedi/criu/commits/io-uring) on that project, but we still need some extra forces to continue that work.
Hi there! I'd like to work on this too if that's possible, tho I have a couple of questions:
- Is there any resource or doc that specifies what's completed and what's left wrt io_uring's support in CRIU?
- Do all the discussions happen on the mailing list?
