DataflowTemplates
DataflowTemplates copied to clipboard
[Bug]: Writing BigNumeric from BigQuery to BigTable results in Java exception message
Related Template(s)
bigquery-to-bigtable
What happened?
In BigQuery there's column of BigNumeric datatype, with the value 99999999999999999999999999999999999.
This BigQuery-to-BigTable writes the column to BigTable without throwing any exception, however, when read from BigTable, the value becomes java.nio.HeapBytesBuffer[pos=0 lim=32 cap=32]
I used cbt read
and BigTable's Python library to read that value, and they are all same.
Beam Version
Newer than 2.35.0
Relevant log output
No response
Found the same issue using Beam version 2.48 and 2.53 as well.