DataflowTemplates icon indicating copy to clipboard operation
DataflowTemplates copied to clipboard

Add support for importing ARRAY, BYTES and STRUCT types into Spanner

Open githubwua opened this issue 5 years ago • 3 comments

Case comment in https://github.com/GoogleCloudPlatform/DataflowTemplates/blob/master/src/main/java/com/google/cloud/teleport/spanner/TextImportPipeline.java mentions the following:

NOTE: BYTES, ARRAY, STRUCT types are not supported.

It is impossible to import tables containing one of these types. The following exception error is thrown.

"Unrecognized or unsupported column data type: ARRAY<STRING(20)>"

Can we please add support for these 3 code types?

githubwua avatar Jan 22 '20 13:01 githubwua

@melburnerodrigues - Can you take a look at this?

sabhyankar avatar Mar 31 '20 15:03 sabhyankar

any news regarding this issue ? Dataflow importing array values from csv is also failing with this error

Unrecognized column data type: ARRAY com.google.cloud.teleport.spanner.TextRowToMutation.parseRow(TextRowToMutation.java:248) com.google.cloud.teleport.spanner.TextRowToMutation.processElement(TextRowToMutation.java:119)

ahmednofal avatar Oct 30 '20 04:10 ahmednofal

Hi, I am experiencing the same issue. Has there been any progress in this regard?

lutherjohnrichards avatar Sep 08 '22 08:09 lutherjohnrichards

This issue has been marked as stale due to 180 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the issue at any time. Thank you for your contributions.

github-actions[bot] avatar Jun 11 '24 02:06 github-actions[bot]

This issue has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

github-actions[bot] avatar Jun 18 '24 02:06 github-actions[bot]