scwhittle

Change google_cloud_bigdataoss_version to 2.2.8.

4

Fixes #21492 This release includes https://github.com/GoogleCloudDataproc/hadoop-connectors/pull/865 which fixes https://github.com/google/conscrypt/issues/864 . ------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [...

Clear side input caches of dofninvoker when finishing bundle. Add microbenchmarks for map_fn with side inputs.

13

Improve the map_fn test by using common utilities. Add support to benchmarks to add profiling. I was originally trying to optimize the code other ways but most of the overhead...

### What happened? Part of refactoring of the commit path for StreamingDataflowWorker introduced a bug when the number of commit threads is increased via `windmillServiceCommitThreads` option. Previously we created a...

Enable MapState and SetState for dataflow streaming engine pipelines with legacy runner by building on top of MultimapState.

3

Tests were not enabled for MapState/SetState for appliance on legacy runner. Enabling tests shows that MapState wasn't conforming to the spec that a read iterator is unaffected by subsequent writes,...

Remove expensive shuffle of read data in KafkaIO when using sdf and commit offsets

5

The reshuffle adds a barrier so that the read records were committed before possibly committing offsets. However this is unnecessary as the DoFn is annotated with RequiresStableInput and the fusion...

------------------------ Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Mention the appropriate issue in your description (for example:...

Support poisioning instruction ids to prevent the FnApi data stream from blocking on failed instructions

1

Previously it could occur that an instruction id was observed on the control stream but due to exception it would never register a handler and the data stream would be...

[Java Harness] Improve heap dump support by configuring JVM to dump heap on OOM exceptions

6

This configures the boot script to use JVM flags so that it dumps heaps to a directory that the MemoryMonitor will look in. Other improvements are made to: - allow...

[Feature Request]: Reduce FnApi error logs for processing that is cancelled for expected reasons

5

### What would you like to happen? The runner of a portable beam pipeline may start processing a bundle that it later wants to cancel. Possible reasons for this could...

Understanding effective connection attempt timeout with heartbeat and idle settings

2

I am trying to reduce latency in detecting failed channel connections and reattempting connections sooner. I am using the cloud spanner client library [code](https://github.com/googleapis/java-spanner/blob/f9505a97bdd9f6da7dd5ab1b60b47f7ed0a70402/google-cloud-spanner/src/main/java/com/google/cloud/spanner/spi/v1/GapicSpannerRpc.java#L354) which uses google api gax library...