Akash Kadakia

Results 13 comments of Akash Kadakia

@je-ik Hi, thanks for the tip, but just tried upgrading to 2.56 and still seeing the same error. I am able to get it to work if I set my...

I am running it through aws managed flink so kind of a black box there, however, the only pipeline option I am passing is --runner=FlinkRunner in addition to my application...

will take a look to ensure no earlier version is being brought in. I was seeing this log: `May 07, 2024 9:51:04 AM org.apache.beam.runners.flink.translation.wrappers.streaming.io.source.FlinkSourceReaderBase notifyNoMoreSplits INFO: Received NoMoreSplits signal from...

I am actually seeing the watermarks work now in the flink runner on the web UI. And also seeing the idle tasks from my source reader get finished which I...

where is autoWatermarkInterval set in beam? Is this a pipeline option or set in the kinesis reader somewhere?

@je-ik is this the same issue as this https://github.com/apache/beam/issues/30903 I noticed you fixed it and the problem statement seems to be similar, but please let me know if this is...

@je-ik Hi, yes that did fix the issue. thank you! For my understanding, what does this option do exactly? And should I expect any performance degradation?

I am noticing actually a lot of back pressure using this approach despite downstream operators having low CPU usage. Is the fix to the root cause relatively straight forward in...

Im surprised this is a bug considering restoring from a flink savepoint is a pretty common use case, is it possible there some configuration missing somewhere? I havent been able...