flink icon indicating copy to clipboard operation
flink copied to clipboard
verified publisher icon apache

[FLINK-33402] 2 CONTINUED

Open varun1729DD opened this issue 1 year ago • 3 comments

Continued from https://github.com/apache/flink/pull/23687

varun1729DD avatar Jan 10 '24 01:01 varun1729DD

CI report:

  • a8189e3282314cff39b8c3f13980ad3413e28af7 Azure: FAILURE
Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

flinkbot avatar Jan 10 '24 01:01 flinkbot

@tweise Continuing this investigation. I tried reader only and the error did not go away Looking at the logs again I still see the concurrency bug as reported in the original Jira thread.

We see the JM (Enumerator) send 'No More Splits event' Screenshot 2024-01-09 at 5 53 55 PM

And shortly after the TM acts on this event and switches to the next source:

Screenshot 2024-01-09 at 5 52 09 PM

What I wonder is what is causing the reader to prematurely close? Synchronization seems to fix it.

varun1729DD avatar Jan 10 '24 01:01 varun1729DD

@tweise requesting your review on this. I added additional details above ^

varun1729DD avatar Feb 09 '24 19:02 varun1729DD