Razvan Culea comments

Results 11 comments of


                                            Razvan Culea

Iobase streaming support in FileBasedSink, exposed in TextIO

Run Python_Examples PreCommit 3.9

Iobase streaming support in FileBasedSink, exposed in TextIO

Run Python_Examples PreCommit 3.9

Iobase streaming support in FileBasedSink, exposed in TextIO

Run Python_Examples PreCommit 3.9

Iobase streaming support in FileBasedSink, exposed in TextIO

Run Python_Examples PreCommit 3.9

Iobase streaming support in FileBasedSink, exposed in TextIO

Run Python_Examples PreCommit 3.9

Iobase streaming support in FileBasedSink, exposed in TextIO

Run Python_Coverage PreCommit

add streaming support to iobase (python)

FYI this PR will be followed up by https://github.com/apache/beam/pull/35253 , to implement the changes in FileBasedSink and expose them in TextIO Another PR will be made for Avro/Parquet/TFrecords IOs

add streaming support to iobase (python)

Run PythonDocker PreCommit 3.9

add streaming support to iobase (python)

Run PythonDocker PreCommit 3.9

BigQueryIO : control StorageWrite parallelism in batch, by reshuffling before write on the number of streams set for BigQueryIO.write() using .withNumStorageWriteApiStreams(numStorageWriteApiStreams)

Why the change: - the BigQueryIO.write using StorageWrite can control the number of streams in streaming - in batch the number of connections will be proportional with the paralellism of...