scio icon indicating copy to clipboard operation
scio copied to clipboard

Label SMB Reads with metadata about SortedBucketIO class

Open clairemcginty opened this issue 3 weeks ago • 0 comments

It would be helpful if SMB read transforms were labeled with info about their component read types (Avro, Parquet, etc)

Proposal: Make the BucketedInput abstract class extend HasDisplayData and have all typed SortedBucketIO.Read/SortedBucketIO.Transform builders implement it with relevant info (i.e for AvroSortedBucketIO, include schema name/generic|specific, input path, etc). Then SortedBucketSource/SortedBucketTransform can append it to their transform labels here.

clairemcginty avatar Jun 07 '24 12:06 clairemcginty