Razvan Culea

BigQueryIO : control StorageWrite parallelism in batch, by reshuffling before write on the number of streams set for BigQueryIO.write() using .withNumStorageWriteApiStreams(numStorageWriteApiStreams)

3

BigQueryIO : control StorageWrite parallelism in batch, by reshuffling before write on the number of streams set for BigQueryIO.write() using .withNumStorageWriteApiStreams(numStorageWriteApiStreams) * BigQueryIO .java - add documentation on how withNumStorageWriteApiStreams...

Iobase streaming support in FileBasedSink, exposed in TextIO

1

FUP to https://github.com/apache/beam/pull/35137 FileBasedSink : * implement pre_finalize_windowed and finalize_windowed_write * handle file naming based on windowing for streaming in internal methods TextIO - expose the new filebasedsink capabilities to...

add streaming support to iobase (python)

7

iobase.Sink has 2 new methods to be implemented for writing in streaming pipelines. * pre_finalize_windowed * finalize_windowed_write These methods are aware of the window and can handle finalization per window...