delete remote and cleanBackupObjectDisks - slow - need batching and parallelization for delete keys

[Slach]

[telperions]

Hi! Thanks for raising this issue. Is there any workaround while waiting new release? It may take hours in our case to wait for cleanBackupObjectDisks. While backup creates in minutes. We have tiered storage structure with old parts of tables on s3.

[Slach]

@s-b90 no workaround right now, unfortunatelly actually root reason is different storage types have different approach for deletion

[telperions]

Is it possible to set BACKUPS_TO_KEEP_LOCAL=0 and BACKUPS_TO_KEEP_REMOTE=0 and manually delete the extra backups from S3?

I can easily find the remote backup location: <S3_BUCKET>/<S3_PATH>|<S3_OBJECT_DISK_PATH>//<backup_name>.

However, I’m not sure where the local backups are stored in S3. Could you help me with that?

[Slach]

yes, i forgot, of course this is possible