Lukasz Cwik
Lukasz Cwik
Run Java_Examples_Dataflow PreCommit
Run Java_Examples_Dataflow PreCommit
@scwhittle A fix in https://github.com/apache/beam/pull/15354 seems to be causing OOMs for certain customer workflows. The customer specifically bounded the number of parallel closes to 2 by patching the code to...
Potential reduction in OOM potential in https://github.com/apache/beam/pull/22645
[email protected] is a good place and also by opening a tracking issue on https://issues.apache.org/jira/projects/BEAM so people can follow the bug.
I see that your converting to json using a custom converter, is there a reason why your not just using the canonical proto json format converter?
I think your looking for: https://github.com/google/protobuf/blob/master/java/util/src/main/java/com/google/protobuf/util/JsonFormat.java
This seems to be a networking latency/reliability issue between your host and GCP. Have you looked at utilities like netstat/trace route/ping to look to see if you can find an...
Why do you want to use a processing time trigger vs using an event time trigger?
Which version of the SDK are you using? Have you tried contacting Google Cloud support and share some job ids with them?