Ubuntu20 arm64安装v1.24.3，calico起不来

[itzhoujun]

calico-node-xx日志：

2022-07-29 13:00:51.719 [ERROR][13669] felix/ipsets.go 574: Bad return code from 'ipset list'. error=exit status 1 family="inet" stderr="ipset v7.1: Kernel and userspace incompatible: settype hash:ip,port,ip with revision 6 not supported by userspace.\n"
2022-07-29 13:00:51.719 [WARNING][13669] felix/ipsets.go 322: Failed to resync with dataplane error=exit status 1 family="inet"
2022-07-29 13:00:51.722 [INFO][13669] felix/ipsets.go 312: Retrying after an ipsets update failure... family="inet"
2022-07-29 13:00:51.730 [ERROR][13669] felix/ipsets.go 574: Bad return code from 'ipset list'. error=exit status 1 family="inet" stderr="ipset v7.1: Kernel and userspace incompatible: settype hash:ip,port,ip with revision 6 not supported by userspace.\n"
2022-07-29 13:00:51.730 [WARNING][13669] felix/ipsets.go 322: Failed to resync with dataplane error=exit status 1 family="inet"
2022-07-29 13:00:51.732 [INFO][13669] felix/ipsets.go 312: Retrying after an ipsets update failure... family="inet"
2022-07-29 13:00:51.734 [ERROR][13669] felix/ipsets.go 574: Bad return code from 'ipset list'. error=exit status 1 family="inet" stderr="ipset v7.1: Kernel and userspace incompatible: settype hash:ip,port,ip with revision 6 not supported by userspace.\n"
2022-07-29 13:00:51.735 [WARNING][13669] felix/ipsets.go 322: Failed to resync with dataplane error=exit status 1 family="inet"
2022-07-29 13:00:51.739 [INFO][13669] felix/ipsets.go 312: Retrying after an ipsets update failure... family="inet"
2022-07-29 13:00:51.742 [ERROR][13669] felix/ipsets.go 574: Bad return code from 'ipset list'. error=exit status 1 family="inet" stderr="ipset v7.1: Kernel and userspace incompatible: settype hash:ip,port,ip with revision 6 not supported by userspace.\n"
2022-07-29 13:00:51.742 [WARNING][13669] felix/ipsets.go 322: Failed to resync with dataplane error=exit status 1 family="inet"
2022-07-29 13:00:51.751 [INFO][13669] felix/ipsets.go 312: Retrying after an ipsets update failure... family="inet"
2022-07-29 13:00:51.753 [ERROR][13669] felix/ipsets.go 574: Bad return code from 'ipset list'. error=exit status 1 family="inet" stderr="ipset v7.1: Kernel and userspace incompatible: settype hash:ip,port,ip with revision 6 not supported by userspace.\n"
2022-07-29 13:00:51.754 [WARNING][13669] felix/ipsets.go 322: Failed to resync with dataplane error=exit status 1 family="inet"
2022-07-29 13:00:51.770 [INFO][13669] felix/ipsets.go 312: Retrying after an ipsets update failure... family="inet"
2022-07-29 13:00:51.772 [ERROR][13669] felix/ipsets.go 574: Bad return code from 'ipset list'. error=exit status 1 family="inet" stderr="ipset v7.1: Kernel and userspace incompatible: settype hash:ip,port,ip with revision 6 not supported by userspace.\n"
2022-07-29 13:00:51.772 [WARNING][13669] felix/ipsets.go 322: Failed to resync with dataplane error=exit status 1 family="inet"
2022-07-29 13:00:51.776 [INFO][13669] felix/int_dataplane.go 1085: Linux interface addrs changed. addrs=set.mapSet{} ifaceName="calico_tmp_B"
2022-07-29 13:00:51.776 [INFO][13669] felix/int_dataplane.go 1085: Linux interface addrs changed. addrs=set.mapSet{} ifaceName="calico_tmp_A"
2022-07-29 13:00:51.795 [INFO][13669] felix/int_dataplane.go 1085: Linux interface addrs changed. addrs=<nil> ifaceName="calico_tmp_B"
2022-07-29 13:00:51.795 [INFO][13669] felix/int_dataplane.go 1085: Linux interface addrs changed. addrs=<nil> ifaceName="calico_tmp_A"
2022-07-29 13:00:51.806 [INFO][13669] felix/ipsets.go 312: Retrying after an ipsets update failure... family="inet"
2022-07-29 13:00:51.816 [ERROR][13669] felix/ipsets.go 574: Bad return code from 'ipset list'. error=exit status 1 family="inet" stderr="ipset v7.1: Kernel and userspace incompatible: settype hash:ip,port,ip with revision 6 not supported by userspace.\n"
2022-07-29 13:00:51.816 [WARNING][13669] felix/ipsets.go 322: Failed to resync with dataplane error=exit status 1 family="inet"
2022-07-29 13:00:51.881 [INFO][13669] felix/ipsets.go 312: Retrying after an ipsets update failure... family="inet"
2022-07-29 13:00:51.884 [ERROR][13669] felix/ipsets.go 574: Bad return code from 'ipset list'. error=exit status 1 family="inet" stderr="ipset v7.1: Kernel and userspace incompatible: settype hash:ip,port,ip with revision 6 not supported by userspace.\n"
2022-07-29 13:00:51.884 [WARNING][13669] felix/ipsets.go 322: Failed to resync with dataplane error=exit status 1 family="inet"
2022-07-29 13:00:52.013 [INFO][13669] felix/ipsets.go 312: Retrying after an ipsets update failure... family="inet"
2022-07-29 13:00:52.016 [ERROR][13669] felix/ipsets.go 574: Bad return code from 'ipset list'. error=exit status 1 family="inet" stderr="ipset v7.1: Kernel and userspace incompatible: settype hash:ip,port,ip with revision 6 not supported by userspace.\n"
2022-07-29 13:00:52.016 [WARNING][13669] felix/ipsets.go 322: Failed to resync with dataplane error=exit status 1 family="inet

[itzhoujun]

命令如下：

sealos run labring/kubernetes:v1.24.3-arm64 labring/calico:v3.22.1-arm64      --masters 10.211.55.3,10.211.55.4,10.211.55.5 -p xxxx

[fanux]

https://github.com/flatcar-linux/Flatcar/issues/174 try this.

[itzhoujun]

flatcar-linux/Flatcar#174 try this.

未安装ipset。哪个版本k8s开始需要ipset？

[itzhoujun]

改用flannel:v0.18.1，结果coredns起不来，报错如下：

plugin type="loopback" failed (add): failed to find plugin "loopback" in path [/opt/cni/bin]

root@node1:~# ls /opt/cni/bin/
flannel

缺少loopback，搜索了一下都说手动弄一个loopback到这个目录下即可，但是为啥会少这个呢？

[cuisongliu]

改用flannel:v0.18.1，结果coredns起不来，报错如下：

plugin type="loopback" failed (add): failed to find plugin "loopback" in path [/opt/cni/bin]

root@node1:~# ls /opt/cni/bin/
flannel

缺少loopback，搜索了一下都说手动弄一个loopback到这个目录下即可，但是为啥会少这个呢？

flannel 没有cni 需要手动安装，先用calico吧

[fanux]

sealos 的 flannel 镜像里可以完善一下这个

[itzhoujun]

这个问题还没解决，麻烦帮忙看下。

[itzhoujun]

本机未安装ipset，试过手动安装到最新版7.15，仍然报一样的错

[itzhoujun]

内核5.15.0-46-generic k8s版本1.19。试过1.24也是报一样的错。 calico:v3.22.1

[fanux]

有没有尝试 calico 社区的是新版本？

[cuisongliu]

换fannel解决该问题。