[Task]: Poor performance of Get File Names on Azure Blob Storage and hundreds of files to list

[xdelox]

What needs to happen?

When you need to obtain a list of files in an Azure container or an inner folder, it can take minutes for a few hundred of files. No content fetched, just to return the file lists.

Issue Priority

Priority: 3

Issue Component

Component: Transforms

[xdelox]

.take-issue

[usbrandon]

Same thing happens in AWS S3.

[hansva]

We know, we might be able to re-use some of the things we do for Azure but it won't be automatically fixed with this ticket.