DataflowTemplates icon indicating copy to clipboard operation
DataflowTemplates copied to clipboard

[Bug]: Writing BigNumeric from BigQuery to BigTable results in Java exception message

Open Ahdw opened this issue 2 years ago • 2 comments

Related Template(s)

bigquery-to-bigtable

What happened?

In BigQuery there's column of BigNumeric datatype, with the value 99999999999999999999999999999999999.

This BigQuery-to-BigTable writes the column to BigTable without throwing any exception, however, when read from BigTable, the value becomes java.nio.HeapBytesBuffer[pos=0 lim=32 cap=32]

I used cbt read and BigTable's Python library to read that value, and they are all same.

Beam Version

Newer than 2.35.0

Relevant log output

No response

Ahdw avatar Aug 26 '22 09:08 Ahdw

Found the same issue using Beam version 2.48 and 2.53 as well.

ee07dazn avatar Feb 27 '24 13:02 ee07dazn