DataflowTemplates icon indicating copy to clipboard operation
DataflowTemplates copied to clipboard

[Feature Request]: Compression support for Spanner to Text template

Open david-simplehash opened this issue 2 years ago • 1 comments

Related Template(s)

SpannerToText

What feature(s) are you requesting?

Template: https://github.com/GoogleCloudPlatform/DataflowTemplates/blob/HEAD/v1/src/main/java/com/google/cloud/teleport/templates/SpannerToText.java

david-simplehash avatar May 22 '23 18:05 david-simplehash

Will take a look at this, thanks for reporting.

Being a classic template, we are a bit limited on what we can do without ValueProviders for the suffix.

Did you consider customizing and building it? We have some easy to follow steps at https://github.com/GoogleCloudPlatform/DataflowTemplates/blob/main/v1/README_Spanner_to_GCS_Text.md

Something like:

.withSuffix(".csv.gz")
.withCompression(Compression.GZIP)

bvolpato avatar Jun 20 '23 03:06 bvolpato

This issue has been marked as stale due to 180 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the issue at any time. Thank you for your contributions.

github-actions[bot] avatar May 20 '24 14:05 github-actions[bot]

This issue has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

github-actions[bot] avatar May 28 '24 02:05 github-actions[bot]