Leverage batch delete in vacuum for Azure Storage

[Dandandan]

Description

Azure supports batching multiple delete operations in a single call. This can speed up vacuum. We shuld add a new delete_objs implementation of StorageBackend for Azure.

Use Case

Related Issue(s) https://github.com/delta-io/delta-rs/issues/394

[akbhuker]

hey, can I have this issue? I'm quite new to this so I might need some guidance

[Dandandan]

hey, can I have this issue? I'm quite new to this so I might need some guidance

Would be great! @houqp can you assing this to @akbhuker ?

I think you can have a look at the implementation for the S3 backend. Let us know when you need the guidance.

[houqp]

Issue assigned, thanks @akbhuker for taking up on this!

[Bernolt]

Hello, Any progress here? if not, I am would be happy to jump in.

[wjones127]

Now that we use objectstore, we should implement this upstream: https://github.com/apache/arrow-rs/issues/2615