django-storages icon indicating copy to clipboard operation
django-storages copied to clipboard

S3Boto3Storage still uses list_objects instead of list_objects_v2 in listdir()

Open radekwlsk opened this issue 3 years ago • 2 comments

Version 1.7.1 reversed use of list_objects_v2 for backwards compatibility as a transition period. It was 2018.

Could django-storages move to list_objects_v2 in 2022 or at least have it as an option behind a setting? Is there something preventing it?

Are there even any real benefits to it? I could not find any performance tests between the two, only more features are mentioned and easier pagination.

radekwlsk avatar Dec 06 '21 13:12 radekwlsk

Same question here. boto3 docs suggests to use the revised list_objects_v2 function

gowthamvbhat avatar Mar 15 '22 08:03 gowthamvbhat

The reason this was is used is that many providers implement the S3 protocol and they do not uniformly implement the v2.

Fair enough that it should be used where possible.

jschneier avatar Sep 03 '23 21:09 jschneier