netdata icon indicating copy to clipboard operation
netdata copied to clipboard

Bigquery collector

Open andrewm4894 opened this issue 3 years ago • 4 comments

Summary

Add a BigQuery collector.

Test Plan

Testing it using our own BigQuery creds and the random data examples in the default config.

Working as expected with multiple jobs where each job can run one or more sql queries and so have 1 or more charts.

image

Additional Information
For users: How does this change affect me?

andrewm4894 avatar Aug 31 '22 12:08 andrewm4894

If I understand it correctly, we need a generic SQL collector. Let's discuss it on Mon @andrewm4894

ilyam8 avatar Sep 09 '22 18:09 ilyam8

Maybe some more generic solution using jdbc drivers and stuff like that could work and maybe be more easily extended to others.

https://cloud.google.com/bigquery/docs/reference/odbc-jdbc-drivers

andrewm4894 avatar Sep 09 '22 20:09 andrewm4894

@ilyam8 i made a more general feature request thats maybe related to this.

https://github.com/netdata/netdata/issues/13659

andrewm4894 avatar Sep 13 '22 11:09 andrewm4894

@ilyam8 i think we should merge this while we wait on a generic sql collector solution. Thoughts?

andrewm4894 avatar Sep 19 '22 12:09 andrewm4894