scio
scio copied to clipboard
Label SMB Reads with metadata about SortedBucketIO class
It would be helpful if SMB read transforms were labeled with info about their component read types (Avro, Parquet, etc)
Proposal: Make the BucketedInput
abstract class extend HasDisplayData
and have all typed SortedBucketIO.Read/SortedBucketIO.Transform builders implement it with relevant info (i.e for AvroSortedBucketIO, include schema name/generic|specific, input path, etc). Then SortedBucketSource/SortedBucketTransform can append it to their transform labels here.