DataflowTemplates
DataflowTemplates copied to clipboard
[Feature Request]: Include attributes in PubSub Message from Spanner Change Streams Message
Related Template(s)
Spanner_Change_Streams_to_PubSub
What feature(s) are you requesting?
I'd like to see tableName
and modType
added to the attributes in PubSub. Messages of subscriptions in Cloud PubSub can only be filtered by attributes. However, in the current implementation, there are no attributes(null
) in the PubSub Messages and there are no ways to filter the message by tableName
or modType
.
https://github.com/GoogleCloudPlatform/DataflowTemplates/blob/8f3de8527ced8b7982c9acebbc66d649edf6649d/v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/transforms/FileFormatFactorySpannerChangeStreamsToPubSub.java#L167