clearml-server icon indicating copy to clipboard operation
clearml-server copied to clipboard

Automatically deleting artifacts and models files from UI

Open montmejat opened this issue 2 years ago • 5 comments

Whenever I'm deleting a task using the web UI, it gives me the list of files that have not been deleted on my AWS storage:

Screenshot from 2022-06-13 16-52-55

So each time I delete a task, I have to manually delete the files I have on AWS. Is there a way to delete tasks where it also deletes my files stored on my AWS bucket?

Thanks!

montmejat avatar Jun 13 '22 14:06 montmejat

By the way, it was a file added using:

clearml_task.upload_artifact(...)

montmejat avatar Jun 13 '22 15:06 montmejat

Hi @aurelien-m,

We're working on this right now - will update soon, I hope 🙂

jkhenning avatar Jun 15 '22 14:06 jkhenning

Thanks!

montmejat avatar Jun 16 '22 15:06 montmejat

Any update on this ? Thanks

Pierrelefort avatar Jan 03 '24 10:01 Pierrelefort

@Pierrelefort The underlying mechanism for artifact deletion was reworked back in ClearML Server v1.7, supporting deleting artifacts from the ClearML File server. Support for external storage services (e.g. AWS S3) is still in the pipeline.

ainoam avatar Jan 03 '24 11:01 ainoam