opendal icon indicating copy to clipboard operation
opendal copied to clipboard

Allow list the same path in concurrently

Open Xuanwo opened this issue 3 years ago • 1 comments

For example, list {a..z} in concurrently and merge them together.

Xuanwo avatar Nov 22 '22 07:11 Xuanwo

Reference: https://joshua-robinson.medium.com/listing-67-billion-objects-in-1-bucket-806e4895130f

image

Xuanwo avatar Jan 24 '23 06:01 Xuanwo

Now we have scan, we can take this issue into consider now.

Xuanwo avatar Apr 12 '23 04:04 Xuanwo

Will this way of concurrent listing ignore non-ASCII keys? Like 烫烫烫-20230618.log

ClSlaid avatar Jun 18 '23 06:06 ClSlaid

Will this way of concurrent listing ignore non-ASCII keys? Like 烫烫烫-20230618.log

Yes, concurrent list should not be applied in this case.

Xuanwo avatar Jun 18 '23 06:06 Xuanwo

This is not a big issue now. Let's close until we have user request.

Xuanwo avatar Nov 20 '23 18:11 Xuanwo