label-studio icon indicating copy to clipboard operation
label-studio copied to clipboard

Temporary Export Files Not Deleted Automatically, Leading to Storage Issues

Open MosbehBarhoumiRAI opened this issue 1 year ago • 2 comments

Describe the bug I have been using Label Studio for almost a year for image annotation (object detection, segmentation, etc.). Recently, my remote server has been running out of storage space. Upon investigation, I found that temporary files were not being deleted automatically. This issue seems related to Docker itself.

After running the Label Studio container, I noticed that the directory /var/lib/docker/overlay2/2cba2b496509f78e63274c6b9bcff18eb43c0fbe55c06ecfc684a1f883902aa3/merged/tmp (associated with the Label Studio container layer) contained thousands of zipped files introduced after each export, which were supposed to be deleted automatically.

To Reproduce

  1. Run Label Studio using the following command:
    docker run -d -it -e LABEL_STUDIO_DISABLE_SIGNUP_WITHOUT_LINK=true -p 8080:8080 -v $(pwd)/mydata:/label-studio/data heartexlabs/label-studio:latest
    
  2. Export any project.
  3. Observe that the exported images are saved in the mentioned location as zipped files, which are not deleted automatically.

Expected behavior Temporary files created during the export process should be deleted automatically to prevent storage issues.

Screenshots Screenshot from 2024-07-22 08-26-30

Environment (please complete the following information):

  • OS: Ubuntu 22.04
  • Label Studio Version: latest

MosbehBarhoumiRAI avatar Jul 22 '24 07:07 MosbehBarhoumiRAI

/jira create

Workflow run Jira issue TRIAG-757 is created

jombooth avatar Jul 31 '24 22:07 jombooth

Hi @MosbehBarhoumi - we've made some changes in this area relatively recently: https://github.com/HumanSignal/label-studio/pull/5612 - it is possible that a bug could have been introduced. We'll investigate!

jombooth avatar Jul 31 '24 22:07 jombooth