ethereum-etl-postgres icon indicating copy to clipboard operation
ethereum-etl-postgres copied to clipboard

Nested schema issue

Open SpacedDot opened this issue 1 year ago • 0 comments

Hi, I try to export BQ data to bucket using this command : bash ethereum_bigquery_to_gcs.sh $BUCKET 2020-01-01 2020-01-31

But I get a error for block:

Extracting export_temp_dataset.bigquery_public_data_crypto_ethereum_blocks_filtered to gs://bucket_s1/bigquery_public_data_crypto_ethereum_blocks_filtered_raw/*.gz ...
BigQuery error in extract operation: Error processing job 'syj553:bqjob_r56ef771b811f325a_00000187719111cb_1': Operation cannot be performed on a nested schema. Field: withdrawals
Composing files in gs://bucket_s1/bigquery_public_data_crypto_ethereum_blocks_filtered_raw/ to gs://bucket_s1/bigquery_public_data_crypto_ethereum_blocks_filtered_composed/
Composing files in gs://bucket_s1/bigquery_public_data_crypto_ethereum_blocks_filtered_composed/ to gs://bucket_s1/bigquery_public_data_crypto_ethereum_blocks_filtered/
CommandException: 1 files/objects could not be removed.
CommandException: 1 files/objects could not be removed

I did some searching and it's about the nested schema. But I thought this script should work fine. Is there something change for the bigquery_public_data.crypto_ethereum ? Or did I miss something?

SpacedDot avatar Apr 11 '23 18:04 SpacedDot