Monitoring of system datastore is not working when used ceph with ceph quota

[Franco-Sparrow]

Description

When using ceph with quota, the image datastore is updated while the system remains unchanged. SDS should not be configured to use more than its 85% of capacity. The monitoring works fine without ceph quota, but not when using ceph quota. Once applied the configuration and having passed the monitoring cicle, only one driver action is executed (the one belonging to the images datastore), while the other is not executed.

To Reproduce

This is the configuration of the images datastore:

onedatastore show 102
DATASTORE 102 INFORMATION
ID             : 102
NAME           : images-hdd
USER           : oneadmin
GROUP          : oneadmin
CLUSTERS       : 0
TYPE           : IMAGE
DS_MAD         : ceph
TM_MAD         : ceph
BASE PATH      : /var/lib/one//datastores/102
DISK_TYPE      : RBD
STATE          : READY

DATASTORE CAPACITY
TOTAL:         : 1.8T
FREE:          : 1.8T
USED:          : 0M
LIMIT:         : -

PERMISSIONS
OWNER          : um-
GROUP          : u--
OTHER          : ---

DATASTORE TEMPLATE
ALLOW_ORPHANS="mixed"
BRIDGE_LIST="Cluster-LA-DEV-node1 Cluster-LA-DEV-node2 Cluster-LA-DEV-node3"
CEPH_HOST="Cluster-LA-DEV-node1 Cluster-LA-DEV-node2 Cluster-LA-DEV-node3"
CEPH_SECRET="45362778-1dc7-4252-a9b9-d9ead80d5338"
CEPH_USER="libvirt"
CLONE_TARGET="SELF"
CLONE_TARGET_SHARED="SELF"
CLONE_TARGET_SSH="SYSTEM"
DISK_TYPE="RBD"
DISK_TYPE_SHARED="RBD"
DISK_TYPE_SSH="FILE"
DRIVER="raw"
DS_MAD="ceph"
LN_TARGET="NONE"
LN_TARGET_SHARED="NONE"
LN_TARGET_SSH="SYSTEM"
POOL_NAME="hcx_pool1"
RESTRICTED_DIRS="/"
SAFE_DIRS="/var/tmp"
TM_MAD="ceph"
TM_MAD_SYSTEM="ssh,shared"
TYPE="IMAGE_DS"

IMAGES

This is the configuration of the system datastore:

onedatastore show 103
DDATASTORE 103 INFORMATION
ID             : 103
NAME           : system-hdd
USER           : oneadmin
GROUP          : oneadmin
CLUSTERS       : 0
TYPE           : SYSTEM
DS_MAD         : -
TM_MAD         : ceph
BASE PATH      : /var/lib/one//datastores/103
DISK_TYPE      : RBD
STATE          : READY

DATASTORE CAPACITY
TOTAL:         : 3.1T
FREE:          : 3.1T
USED:          : 0M
LIMIT:         : -

PERMISSIONS
OWNER          : um-
GROUP          : u--
OTHER          : ---

DATASTORE TEMPLATE
ALLOW_ORPHANS="mixed"
BRIDGE_LIST="Cluster-LA-DEV-node1 Cluster-LA-DEV-node2 Cluster-LA-DEV-node3"
CEPH_HOST="Cluster-LA-DEV-node1 Cluster-LA-DEV-node2 Cluster-LA-DEV-node3"
CEPH_SECRET="45362778-1dc7-4252-a9b9-d9ead80d5338"
CEPH_USER="libvirt"
DISK_TYPE="RBD"
DS_MIGRATE="NO"
POOL_NAME="hcx_pool1"
RESTRICTED_DIRS="/"
SAFE_DIRS="/var/tmp"
SHARED="YES"
TM_MAD="ceph"
TYPE="SYSTEM_DS"

IMAGES

Enable ceph quota:

ceph osd pool set-quota hcx_pool1 max_bytes 2000000000000

Expected behavior

Monitoring of system datastore working as expected, and updating the system datastore, like images datastore do.

Details

• Affected Component: [Storage]
• Hypervisor: [KVM]
• Version: [6.8.2]

Additional context Add any other context about the problem here.

Progress Status

• [ ] Code committed
• [ ] Testing - QA
• [ ] Documentation (Release notes - resolved issues, compatibility, known issues)

[atodorov-storpool]

Not sure if this is an issue, but is there a space between the hostnames 1 and 2?

CEPH_HOST="Cluster-LA-DEV-node1Cluster-LA-DEV-node2 Cluster-LA-DEV-node3"

[Franco-Sparrow]

Sorry, that was me renaming the hosts from their original hostname, while I was creating this bug report.

This is not related with the bug reported here. There is an issue in the monitoring system datastore for ceph, when it has ceph quota enabled.

El mar, 16 abr 2024, 2:02 a. m., Anton Todorov @.***> escribió:

Not sure if this is an issue, but is there a space between the hostnames 1 and 2?

CEPH_HOST="Cluster-LA-DEV-node1Cluster-LA-DEV-node2 Cluster-LA-DEV-node3"

— Reply to this email directly, view it on GitHub https://github.com/OpenNebula/one/issues/6564#issuecomment-2058292133, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANRJPN7JYYCXBM47ECEV6S3Y5S5GVAVCNFSM6AAAAABGIQJLXWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANJYGI4TEMJTGM . You are receiving this because you authored the thread.Message ID: @.***>

[kCyborg]

Any advance on this subject? I just tested it and so far the monitoring of the system datastore doesnt seem to like the quota in the ceph background... Maybe...

Is there a way to set the quota from the onedatastore cli?

[rsmontero]

This is now fixed in master for the next release.