cmc-csci143 icon indicating copy to clipboard operation
cmc-csci143 copied to clipboard

Disk quota exceeded in twitter postgres parallel

Open dchen327 opened this issue 7 months ago • 3 comments

Just tried to run docker compose up, but getting this

 > [pg_denormalized 1/5] FROM docker.io/library/postgres:13@sha256:d714ce760cbf3572aa9f72d9f305f27de79b9e6bdbf81613cd4859df5408831e:
------
failed to solve: failed to register layer: write /usr/lib/x86_64-linux-gnu/libLLVM.so.19.1: disk quota exceeded

Tried docker system prune -a but still getting this error. Also tried swapping between ~ and ~/bigdata, although I don't think this does anything since the quota is in /usr/lib?

dchen327 avatar Apr 15 '25 02:04 dchen327

/usr/lib/x86_64-linux-gnu/libLLVM.so.19.1 is not where you have run out of disk space, it is the library that is running that triggers the error. You do not have permission to write to /usr/lib.

The problem is that you have exceeded your 10gb quota in your $HOME folder. Changing to ~/bigdata does not help because docker stores all of its files in ~/.local/docker which will still contribute to your 10gb quota.

To fix this problem, you need to identify which files/folders are using up all the disk space and then delete them. You can see what is using disk space by running du -hd1 . in the home folder. Then use the rm command to delete files.

mikeizbicki avatar Apr 15 '25 03:04 mikeizbicki

du -hd1 only showed around 2.7G being used in my $HOME folder so not sure if I was surpassing the 10gb?

But I deleted some old images and that freed up ~1gb in .local so that fixed everything for now :)

Is there a different quota set somewhere for total size of docker images?

dchen327 avatar Apr 15 '25 03:04 dchen327

Docker stores its files without setting user read permission on the files.

Detail: That is, it does chmod 0 $file. You can't actually remove yourself from having read/write permission to your own files, and so docker can still read them, but by default this permissions setting will not allow a program to open a file unless it overrides the permissions. This is sometimes called "write protecting" the file.

So you probably noticed a bunch of error messages about the du command not having permission to open these files. This is where your extra disk space usage is going. Deleting unused docker containers/images/volumes would free up this extra disk space.

mikeizbicki avatar Apr 15 '25 03:04 mikeizbicki