bigquery-schema-generator
bigquery-schema-generator copied to clipboard
bxparks
Generates the BigQuery schema from newline-delimited JSON or CSV data records.
I used _bigquery-schema-generator_ for relatively small CSV file (320 mb). After reading 30,000 lines Attribute error was thrown stating: AttributeError: 'NoneType' object has no attribute 'lower' ``` INFO:root:Processing line 1000...
[FEATURE] Starting with an existing schema, epoch time cannot mismatched type TIMESTAMP --> INTEGER
# Current Behavior When starting with an existing bigquery schema that has a TIMESTAMP field in it we get an error when trying to load logs which contain an epoch...
From a comment by @bxparks in #57 regarding the sections within the DataReader class. > Hmm, it's getting harder to keep track of which tags are allowed in which sections....
Currently, the optional timezone indicator on a TIMESTAMP field is expected to contain a colon (:) character. For example: 2017-05-22 12:33:01-07:30 However, [ISO8601](https://en.wikipedia.org/wiki/ISO_8601) allows a timezone format without the colon...
