DataflowTemplates icon indicating copy to clipboard operation
DataflowTemplates copied to clipboard

[Feature Request]: Include attributes in PubSub Message from Spanner Change Streams Message

Open yu-hasebe opened this issue 1 year ago • 0 comments

Related Template(s)

Spanner_Change_Streams_to_PubSub

What feature(s) are you requesting?

I'd like to see tableName and modType added to the attributes in PubSub. Messages of subscriptions in Cloud PubSub can only be filtered by attributes. However, in the current implementation, there are no attributes(null) in the PubSub Messages and there are no ways to filter the message by tableName or modType.

https://github.com/GoogleCloudPlatform/DataflowTemplates/blob/8f3de8527ced8b7982c9acebbc66d649edf6649d/v2/googlecloud-to-googlecloud/src/main/java/com/google/cloud/teleport/v2/transforms/FileFormatFactorySpannerChangeStreamsToPubSub.java#L167

yu-hasebe avatar Aug 22 '23 03:08 yu-hasebe