moosefs-docker-cluster icon indicating copy to clipboard operation
moosefs-docker-cluster copied to clipboard

Published 20 hours ago • verified publisher icon moosefs

Disk size limits do not work as expected

Open Derkades opened this issue 4 years ago • 4 comments

When creating four chunk servers with a single disk (but actually all on the same host disk), environment variable SIZE=10 one expects to get four chunk servers that show 0GB / 10GB (0%) used. However, the web interface shows 10GB / 10GB (100%) used. Creating files fails with an out of space error.

image

When removing the size limit the cause of this issue becomes immediately obvious: image To calculate 'used' space moosefs uses the drive's used space instead of the size of files actually stored in the directory. This makes a lot of sense due to performance and inconsistency issues when counting individual files, but it makes the SIZE option a lot less useful.

It took me quite a while to figure out why all my disks showed as full, if there is no good fix for this at least you should document this in the README or manual in my opinion.

Derkades avatar Nov 15 '20 20:11 Derkades

It appears that as soon as one object is uploaded it calculates used space correctly image

Derkades avatar Nov 16 '20 11:11 Derkades

my test setup does not want to store anything. it says no space on device :)

rocinante-sys avatar Dec 06 '20 13:12 rocinante-sys

@rocinante-sys Are you using storage quotas (SIZE environment variable)?

Derkades avatar Dec 06 '20 20:12 Derkades

@Derkades yes, I saw in first post that is the issue. It works if I leave it out :+1:

rocinante-sys avatar Dec 07 '20 00:12 rocinante-sys