codalab-competitions icon indicating copy to clipboard operation
codalab-competitions copied to clipboard

Error: No space left on device

Open seanko29 opened this issue 10 months ago • 3 comments

Hello! I am currently participating in PBVS2025 competition. However, for some zip files, I have an issue with error: no space left on device. Why is it so? Its not that I am uploading any model weights but output images only (3.7MB zip filed) Below are url links and the error prints.

thank you in advanced!

https://codalab.lisn.upsaclay.fr/competitions/21247 user id: aimf_ko

Unable to find image 'rafariva/rafariva:latest' locally latest: Pulling from rafariva/rafariva docker: failed to register layer: write /usr/lib/x86_64-linux-gnu/nss/libfreeblpriv3.so: no space left on device.

seanko29 avatar Feb 28 '25 10:02 seanko29

Hi @seanko29,

Thank you for reporting this problem. This is likely due to a problem with a compute worker.

As the competition is using the "Default queue" to compute the submissions, we need to investigate the workers on our side.

@ObadaS Do you have a time to look at this? Otherwise, I can check that on Tuesday.

Didayolo avatar Mar 07 '25 21:03 Didayolo

@Didayolo Yes, I did take a look. There are too many big docker images on the worker. It's something we need to discuss further during our meetings

ObadaS avatar Mar 10 '25 09:03 ObadaS

We could set the crontab to "every 12 hours" instead of daily

Didayolo avatar Mar 20 '25 15:03 Didayolo