cmc-csci143 icon indicating copy to clipboard operation
cmc-csci143 copied to clipboard

File System Full

Open kjiang25 opened this issue 7 months ago • 1 comments

After loading tweets into the database overnight, I woke up to see that no files could be saved due to my file system being full. The following error shows when trying to save a file.

</pg_normalized_batch/schema-indexes.sql"
"services/pg_normalized_batch/schema-indexes.sql" E514: Write error (file system full?) Press ENTER or type command to continue

I did a quick search and saw that df -h displays my disk usage, which gave the following output.

Filesystem Size Used Avail Use% Mounted on tmpfs 26G 14M 26G 1% /run efivarfs 512K 47K 461K 10% /sys/firmware/efi/efivars /dev/mapper/ubuntu--vg-ubuntu--lv 1.8T 1.7T 0 100% / tmpfs 126G 1.1M 126G 1% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock /dev/nvme0n1p2 2.0G 185M 1.7G 11% /boot /dev/nvme0n1p1 1.1G 6.2M 1.1G 1% /boot/efi /dev/sda1 48T 41T 3.9T 92% /data tmpfs 26G 20K 26G 1% /run/user/1001 ...

It appears that /dev/mapper/ubuntu--vg-ubuntu--lv has used 100% of its space and /dev/sda1 has used 92% of its space. The fixes that were suggested online needed sudo permissions to clear storage, so I would like to know what I can do with my current permissions.

kjiang25 avatar May 02 '25 17:05 kjiang25

In the future, use markdown code blocks for verbatim output of commands.

df stands for Disk Free and reports the free space on the various hard drives (technically partitions) attached to the lambda server. You are looking for the du command which reports the Disk Usage of a certain folder.

You should:

  1. Run du -hd1 $HOME to see which folders you have are consuming the most space in your home folder. Recall that you have 10GB of space allotted.
  2. Resources used by docker are by default displayed in the output of the du command. (Technically, they are stored in $HOME/.local and so they are using your storage, but docker has run chmod u-rwx to remove all permissions prevent someone from manually editing these files.) If the du command does not report substantial disk space usage, then you should delete the volumes / images / containers via docker.

mikeizbicki avatar May 02 '25 20:05 mikeizbicki