fluent-plugin-bigquery

fluent-plugin-bigquery copied to clipboard

This PR removes the README organization's notice, given that the repo has already been transferred.

Leodau

Support Ruby >= 3.0

1

This pull request fixes raising `ArgumentError` exception when run on Ruby >= 3.0 due to [incompatible changes of keyword arguments](https://www.ruby-lang.org/en/news/2019/12/12/separation-of-positional-and-keyword-arguments-in-ruby-3-0/). I have confirmed that it works with the [td-agent package...

hirose31

Can use strftime-formatting with fluentd 1.x.x?

1

## Environments - fluentd version: 1.14.6 - plugin version: 2.3.0 ## Configuration ```conf @type record_modifier remove_keys container_id,container_name,source tag ${tag.gsub('-','_')} @type bigquery_insert @id stdout_bigquery_insert_${tag[1]} auth_method json_key json_key "#{ENV['BIGQUERY_JSON_KEY']}" project "#{ENV['BIGQUERY_PROJECT_NAME']}" dataset...

mugioka

I can see here: https://github.com/fluent-plugins-nursery/fluent-plugin-bigquery/blob/b86cce93b57712c641cf5e37c6733ee88a269cff/lib/fluent/plugin/out_bigquery_insert.rb#L100-L105 If I understand correctly the code here, in case of bigquery insert error, it is checked if the error is retryable, and only if it...

Elyahou

## Environments - fluentd version: 1.11.1 - plugin version: 2.2.0 ## Configuration ``` @type record_modifier browserVersion "${record['browser'] && record['browser']['version']}" operationSystemVersion "${record['operatingSystem'] && record['operatingSystem']['version']}" browser "${record['browser'] && record['browser']['name']}" operatingSystem "${record['operatingSystem'] &&...

dobesv

I can't output data to Bigqueiry when the contents cotains Chinese in WINDOWS。 Errors like these： 2019-09-19 13:17:25 +0800 [debug]: #0 taking back chunk for errors. chunk="592e1119616f5807079b362bfb2383f9" 2019-09-19 13:17:25 +0800...

MinghuiChen

Can't push legacy buffer files automatic after fluentd restart

1

For some reason (for example:lost some fields of BigQuery table or network problem), the fluentd buffer have many files. After it restart, the legacy buffer files can't push into bigquery...

breath-co2

Date partitioned table error

1

## Environments - fluentd version: 1.4.0 - plugin version: 2.1.0 ## Configuration ``` @type copy @type stdout @type bigquery_load project tibo auth_method application_default dataset "mylog#{ENV['RAILS_ENV'] != 'production' ? '_alpha' :...

meoooh

Add new feature of bigquery-avro-load job

3

Work together with [fluent-plugin-avro](https://github.com/takebayashi/fluent-plugin-avro) ### Acknowledgements I would like to extend my sincere gratitude to my team leader, for his instructive advice and useful discussions make me realize where the...

seii-saintway

Error streaming to GBQ

1

Hello, I'm doing migration form fluentd 0.12 to 1.0 I have error message like " message="Error while reading data, error message: JSON table encountered too many errors, giving up. Rows:...

aplsms