new feature BigQuery Storage API

[neXus1987]

Google BigQuery released a new Storage API (also more cost efficient including free contigents):

https://cloud.google.com/bigquery/docs/write-api

[loicmathieu]

Hi, Thanks for the information. It appears it is supported by the Java client so it should already be possible with the current implementation. What do you want us to achieve with this issue ? Do we need to update the version of the Java client to enable it ?

[neXus1987]

Update and as i understand there is a new dependency for this:

  <dependency>
    <groupId>com.google.cloud</groupId>
    <artifactId>google-cloud-bigquerystorage</artifactId>
  </dependency>

So as i understand there is a special client needed instead of just "bigquery" we need a bigquerywriteclient.

[loicmathieu]

OK, thanks, I'll have a look.

[loicmathieu]

I checked and it will require a new extension to add the new dependency and produce new CDI beans for the new object BigQueryWriteClient and proper testing and documentation.

[zanmagerl]

I can start on this (as I have a use case for this) if you do not object @loicmathieu ?

[loicmathieu]

@zanmagerl OK, go! :+1:

[neXus1987]

great news, thanks a lot!!!