Akansha Maloo
Akansha Maloo
feat: add dataflux interface and helper functions to storage/dataflux. Dataflux fast-listing will be used to quickly list objects in a bucket in parallel. Fixes https://github.com/googleapis/google-cloud-go/issues/10731
To list large dataset in a GCS bucket sequential it takes a long time. If we can list objects in parallel, it will be much faster to complete listing. Dataflux...
feat: run worksteal listing parallel to sequential listing Dataflux fast-listing leverages worksteal algorithm to quickly list objects in a bucket by running several parallel processes. Worksteal algorithm splits a given...