opendal icon indicating copy to clipboard operation
opendal copied to clipboard

Add batch delete support for gcs

Open Xuanwo opened this issue 2 years ago • 1 comments

Xuanwo avatar Feb 20 '23 03:02 Xuanwo

/assign

hawkingrei avatar Mar 02 '23 09:03 hawkingrei

Hi @hawkingrei, do you have any updates regarding this issue?

Xuanwo avatar Apr 12 '23 04:04 Xuanwo

Hello @wcy-fdu, it appears that @hawkingrei has been busy lately. Would you be willing to investigate this issue?

Xuanwo avatar Apr 22 '23 08:04 Xuanwo

Hello @wcy-fdu, it appears that @hawkingrei has been busy lately. Would you be willing to investigate this issue?

Sure! Feel free to assign to me~

wcy-fdu avatar Apr 22 '23 08:04 wcy-fdu

As discussed in https://github.com/apache/incubator-opendal/pull/2097, gcs doesn't support batch delete at all. Thanks and sorry for wasting your time @wcy-fdu.

Closing now.

Xuanwo avatar Apr 24 '23 07:04 Xuanwo

Oh, wait. We can use https://cloud.google.com/storage/docs/batch. cc @wcy-fdu

You should not include more than 100 calls in a single batch request. If you need to make more calls than that, use multiple batch requests. The total batch request payload must be less than 10MB.

Xuanwo avatar Apr 24 '23 07:04 Xuanwo

Implemented by https://github.com/apache/incubator-opendal/pull/2142

Xuanwo avatar Jun 08 '23 00:06 Xuanwo