google-cloud icon indicating copy to clipboard operation
google-cloud copied to clipboard

Published 20 hours ago • verified publisher icon data-integrations

Handle nullable arrays in BigQuery Sink

Open VictorD-Veolia opened this issue 3 years ago • 1 comments

BigQuery fields can't be both NULLABLE and REQUIRED. However, it is still possible to insert null arrays BigQuery, which are then converted into empty arrays.

There is then no reason to deny users from using schema with nullable arrays in the BigQuery Sink.

VictorD-Veolia avatar May 10 '21 10:05 VictorD-Veolia

Hi @bdmogal. I updated the unit test for the behavior fixed in this PR and created an issue in JIRA : https://cdap.atlassian.net/browse/PLUGIN-795

VictorD-Veolia avatar Aug 11 '21 14:08 VictorD-Veolia

Merged as part of https://github.com/data-integrations/google-cloud/pull/1001.

itsankit-google avatar Apr 02 '24 19:04 itsankit-google