[Feature Request]: SFTP Transform to return as list of folders and files in a site.

[usbrandon]

What would you like to happen?

Some of our vendors distribute files to us nightly contained in a folder named using a timestamp of when they produced the files. I need a transform that can give me a list of folders and files within folders so I can narrow the list down to what I need to download.

Real scenario

The vendor creates timestamped folders representing when the data was prepared for us. I need a way to figure out the latest folder in that list, then list the files inside the folder and commence downloading and processing them into our data warehouse.

I could use the same step twice, once to get a list of folders, then pass the latest to the step again so it will get me a file listing in that folder. Then I could send that file listing to an SFTP Get File step where it will download each one from my file list in the rowset.

Issue Priority

Priority: 2

Issue Component

Component: Transforms