ceph
Question about osd directory
i tried to run this command :
sudo ceph-volume lvm create --data /dev/vdb
here is the output :
[Running] command: /bin/ceph-authtool --gen-print-key Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new e20021e9-5656-41f9-8386-990620ad3f09 Running command: nsenter --mount=/rootfs/proc/1/ns/mnt --ipc=/rootfs/proc/1/ns/ipc --net=/rootfs/proc/1/ns/net --uts=/rootfs/proc/1/ns/uts /sbin/vgcreate --force --yes ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5 /dev/vdb stdout: Physical volume "/dev/vdb" successfully created. stdout: Volume group "ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5" successfully created Running command: nsenter --mount=/rootfs/proc/1/ns/mnt --ipc=/rootfs/proc/1/ns/ipc --net=/rootfs/proc/1/ns/net --uts=/rootfs/proc/1/ns/uts /sbin/lvcreate --yes -l 1279 -n osd-block-e20021e9-5656-41f9-8386-990620ad3f09 ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5 stdout: Logical volume "osd-block-e20021e9-5656-41f9-8386-990620ad3f09" created. Running command: /bin/ceph-authtool --gen-print-key Running command: /bin/mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-2 Running command: /bin/chown -h ceph:ceph /dev/ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5/osd-block-e20021e9-5656-41f9-8386-990620ad3f09 Running command: /bin/chown -R ceph:ceph /dev/dm-0 Running command: /bin/ln -s /dev/ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5/osd-block-e20021e9-5656-41f9-8386-990620ad3f09 /var/lib/ceph/osd/ceph-2/block Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o /var/lib/ceph/osd/ceph-2/activate.monmap stderr: got monmap epoch 3 --> Creating keyring file for osd.2 Running command: /bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2/keyring Running command: /bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2/ Running command: /bin/ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 2 --monmap /var/lib/ceph/osd/ceph-2/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-2/ --osd-uuid e20021e9-5656-41f9-8386-990620ad3f09 --setuser ceph --setgroup ceph stderr: 2024-02-04T15:01:58.392+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/) _read_fsid unparsable uuid stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.504+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.932+0000 7f6ce614e540 -1 bluestore(/var/lib/ceph/osd/ceph-2//block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2//block: (13) Permission denied stderr: 2024-02-04T15:01:58.932+0000 7f6ce614e540 -1 bdev(0x55bb48825400 /var/lib/ceph/osd/ceph-2//block) open open got: (13) Permission denied stderr: 2024-02-04T15:01:58.932+0000 7f6ce614e540 -1 OSD::mkfs: ObjectStore::mkfs failed with error (13) Permission denied stderr: 2024-02-04T15:01:58.932+0000 7f6ce614e540 -1 ** ERROR: error creating empty object store in /var/lib/ceph/osd/ceph-2/: (13) Permission denied --> Was unable to complete a new OSD, will rollback changes Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring osd purge-new osd.2 --yes-i-really-mean-it stderr: purged osd.2 --> Zapping: /dev/ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5/osd-block-e20021e9-5656-41f9-8386-990620ad3f09 --> Unmounting /var/lib/ceph/osd/ceph-2 Running command: /bin/umount -v /var/lib/ceph/osd/ceph-2 stderr: umount: /var/lib/ceph/osd/ceph-2 unmounted Running command: /bin/dd if=/dev/zero of=/dev/ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5/osd-block-e20021e9-5656-41f9-8386-990620ad3f09 bs=1M count=10 conv=fsync stderr: 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.0468115 s, 224 MB/s --> Only 1 LV left in VG, will proceed to destroy volume group ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5 Running command: nsenter --mount=/rootfs/proc/1/ns/mnt --ipc=/rootfs/proc/1/ns/ipc --net=/rootfs/proc/1/ns/net --uts=/rootfs/proc/1/ns/uts /sbin/vgremove -v -f ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5 stderr: Removing ceph--eb2f5ca0--e04f--4307--997d--5244f8583cf5-osd--block--e20021e9--5656--41f9--8386--990620ad3f09 (253:0) stderr: Archiving volume group "ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5" metadata (seqno 5). Releasing logical volume "osd-block-e20021e9-5656-41f9-8386-990620ad3f09" stderr: Creating volume group backup "/etc/lvm/backup/ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5" (seqno 6). stdout: Logical volume "osd-block-e20021e9-5656-41f9-8386-990620ad3f09" successfully removed stderr: Removing physical volume "/dev/vdb" from volume group "ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5" stdout: Volume group "ceph-eb2f5ca0-e04f-4307-997d-5244f8583cf5" successfully removed Running command: nsenter --mount=/rootfs/proc/1/ns/mnt --ipc=/rootfs/proc/1/ns/ipc --net=/rootfs/proc/1/ns/net --uts=/rootfs/proc/1/ns/uts /sbin/pvremove -v -f -f /dev/vdb stdout: Labels on physical volume "/dev/vdb" successfully wiped. --> Zapping successful for OSD: 2 --> RuntimeError: Command failed with exit code 250: /bin/ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 2 --monmap /var/lib/ceph/osd/ceph-2/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-2/ --osd-uuid e20021e9-5656-41f9-8386-990620ad3f09 --setuser ceph --setgroup ceph
im pretty sure all the directory and file already chown to ceph.
