cloudpods icon indicating copy to clipboard operation
cloudpods copied to clipboard

[求助/Help]虚拟机挂载ceph rbd失败

Open hawchiang opened this issue 2 months ago • 8 comments

宿主机系统:openEuler 24.03 (LTS-SP2) cloudpods版本:3.11.12 报错信息: [info 2025-10-29 12:33:18 workmanager.(workerTask).Run(manager.go:96)] DelayTask failed: Deploy guest fs: request deploy guest fs: rpc error: code = Unknown desc = Connect: failed start guest ./src/common/ceph_crypto.cc: In function 'void ceph::crypto::init(CephContext)' thread 7efc09c1f0c0 time 2025-10-29 12:33:17.275427 ./src/common/ceph_crypto.cc: 62: FAILED ceph_assert(crypto_context != __null) ceph version 14.2.21 (5ef401921d7a88aea18ec7558f7f9374ebd8f5a6) nautilus (stable) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12f) [0x7efc0ae4762b] 看着是ceph版本没对上导致的,但检查宿主机ceph-common和ceph集群ceph版本都是18.2.2

hawchiang avatar Oct 29 '25 12:10 hawchiang

@hawchiang 请检查一下 /etc/yum.repo.d/yunion.repo 内容,注意 [yunion-repo-base] 的baseurl 是否是 ?

https://iso.yunion.cn/rpm/10/x86_64

如果不是,请更换为该URL。保存退出后,执行

yum makecache
yum reinstall -y yunion-qemu-4.2.0

再试试是否可以访问 18.x 的 ceph

swordqiu avatar Oct 29 '25 15:10 swordqiu

找出问题了,qemu-4.2.0没办法使用高版本的ceph,qemu可以升级吗?

hawchiang avatar Oct 30 '25 07:10 hawchiang

@hawchiang 收到,我们考虑一下

swordqiu avatar Oct 30 '25 10:10 swordqiu

@hawchiang 是否重新安装了 qemu ,我们在最新的版本使用 bundle libraries 的方式打包的qemu,不依赖宿主机上的动态库,所以可能是打包的qemu ceph动态库版本过低的问题

@hawchiang 请检查一下 /etc/yum.repo.d/yunion.repo 内容,注意 [yunion-repo-base] 的baseurl 是否是 ?

https://iso.yunion.cn/rpm/10/x86_64

如果不是,请更换为该URL。保存退出后,执行

yum makecache
yum reinstall -y yunion-qemu-4.2.0

再试试是否可以访问 18.x 的 ceph

wanyaoqi avatar Oct 31 '25 03:10 wanyaoqi

我直接用这个打包好的qemu的qemu-img去使用ceph就会触发这个报错,测试qemu升级到7.2版本的可以正常使用

hawchiang avatar Oct 31 '25 03:10 hawchiang

@hawchiang 这个是因为你使用的 qemu 用的是操作系统安装的动态链接库,ceph-common是 18.2版本的,我们打包好的qemu 会把ceph 相关的动态链接库也打进去,虽然也区分了 ceph版本,但是可能安装错了,需要重新安装测试。动态链接库的位置在 /usr/local/qemu-4.2.0/bin/bundles 下

wanyaoqi avatar Oct 31 '25 03:10 wanyaoqi

重装了,还是不行 yum reinstall -y yunion-qemu-4.2.0 Last metadata expiration check: 0:00:28 ago on Fri Oct 31 07:19:12 2025. Dependencies resolved. Running transaction check Transaction check succeeded. Running transaction test Transaction test succeeded. Running transaction Preparing : 1/1 Reinstalling : yunion-qemu-4.2.0-4.2.0-20250822.x86_64 1/2 Cleanup : yunion-qemu-4.2.0-4.2.0-20250822.x86_64 2/2 Verifying : yunion-qemu-4.2.0-4.2.0-20250822.x86_64 1/2 Verifying : yunion-qemu-4.2.0-4.2.0-20250822.x86_64 2/2

Reinstalled: yunion-qemu-4.2.0-4.2.0-20250822.x86_64

Complete! [root@vm-host ~]# /usr/local/qemu-4.2.0/bin/qemu-img create -f raw rbd:cloud-vm/test2 10g Formatting 'rbd:cloud-vm/test2', fmt=raw size=10737418240 ./src/common/ceph_crypto.cc: In function 'void ceph::crypto::init(CephContext*)' thread 7f47a09afd80 time 2025-10-31 07:20:19.091263 ./src/common/ceph_crypto.cc: 62: FAILED ceph_assert(crypto_context != __null) ceph version 14.2.21 (5ef401921d7a88aea18ec7558f7f9374ebd8f5a6) nautilus (stable) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12f) [0x7f47a164762b] 2: (()+0x2477b6) [0x7f47a16477b6] 3: (()+0x36756c) [0x7f47a176756c] 4: (MonClient::get_monmap_and_config()+0x106) [0x7f47a1a1ed66] 5: (()+0x940ca) [0x7f47aaf5e0ca] 6: (()+0xc008b) [0x7f47ab6f308b] 7: (()+0xc0610) [0x7f47ab6f3610] 8: (()+0xc0f65) [0x7f47ab6f3f65] 9: (()+0x312fd) [0x7f47ab6642fd] 10: (()+0x32618) [0x7f47ab665618] 11: (()+0x312fd) [0x7f47ab6642fd] 12: (()+0x1245d3) [0x7f47ab7575d3] 13: (()+0x4dd80) [0x7f47aa879d80] Aborted (core dumped)`

hawchiang avatar Oct 31 '25 07:10 hawchiang

@hawchiang 在这台宿主机上执行 ceph -s 正常吗?

/usr/local/qemu-4.2.0/bin/qemu-img create -f raw rbd:cloud-vm/test2 10g 应该需要 ceph 的认证信息

zexi avatar Nov 10 '25 11:11 zexi

If you do not provide feedback for more than 37 days, we will close the issue and you can either reopen it or submit a new issue.

您超过 37 天未反馈信息,我们将关闭该 issue,如有需求您可以重新打开或者提交新的 issue。

github-actions[bot] avatar Dec 18 '25 02:12 github-actions[bot]