Get count of records loaded

[OmkarPathak]

trafficstars

Is there a way to get the total number of records loaded in bigquery?

[sakama]

The only way might be to parse the INFO log now.

• when is_skip_job_result_check: false

2020-02-28 11:48:04.446 +0900 [INFO] (0001:transaction): embulk-output-bigquery: transaction_report: {"num_input_rows":4,"num_response_rows":4,"num_output_rows":4,"num_rejected_rows":0}

• when is_skip_job_result_check: true If you set true for this option, this plugin doesn't check the BQ job result after inserting data. Thus, the number is not a loaded data. That would be a number of data that this plugin tried to load.

2020-02-28 11:56:51.018 +0900 [INFO] (0001:transaction): embulk-output-bigquery: transaction_report: {"num_input_rows":4}

https://github.com/embulk/embulk-output-bigquery/blob/master/lib/embulk/output/bigquery.rb#L265-L284

[hiroyuki-sato]

I close this issue but feel free to reopen if you need.