beam icon indicating copy to clipboard operation
beam copied to clipboard

[Bug]: beam_PostCommit_Java_ValidatesRunner_Flink is flakes in org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testAfterProcessingTimeContinuationTriggerUsingState

Open jrmccluskey opened this issue 3 years ago • 4 comments

What happened?

org.apache.beam.sdk.transforms.GroupByKeyTest > org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testAfterProcessingTimeContinuationTriggerUsingState tests is flaky in the Java Flink ValidatesRunner PosCommit suite.

https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/testReport/org.apache.beam.sdk.transforms/GroupByKeyTest$BasicTests/testAfterProcessingTimeContinuationTriggerUsingState/

Issue Priority

Priority: 1

Issue Component

Component: test-failures

jrmccluskey avatar Aug 26 '22 13:08 jrmccluskey

Not failing today. It does have some flakes, but not this one from what I can see.

kennknowles avatar Sep 13 '22 23:09 kennknowles

Wait, I read it wrong. This is exactly the flake.

kennknowles avatar Sep 13 '22 23:09 kennknowles

org.apache.beam.sdk.transforms.ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful is tracked in #21266

Maybe this should just track the GroupByKey one? It does look quite flaky: image

TheNeuralBit avatar Sep 14 '22 21:09 TheNeuralBit

Updated the description so this just tracks the GroupByKeyTest failure. Let's use https://github.com/apache/beam/issues/21266 to track the ParDoLifecycleTest flake

TheNeuralBit avatar Sep 21 '22 18:09 TheNeuralBit

This is the top flaky test in the suite. Recent failures: https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/10960/testReport/org.apache.beam.sdk.transforms/GroupByKeyTest$BasicTests/testAfterProcessingTimeContinuationTriggerUsingState/ https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/10961/testReport/org.apache.beam.sdk.transforms/GroupByKeyTest$BasicTests/testAfterProcessingTimeContinuationTriggerUsingState/

java.lang.AssertionError: Second Triggered sum/Values/Values/Map/ParMultiDo(Anonymous).output: 
Expected: iterable with items [<42>] in any order
     but: no match for: <84>
	at org.apache.beam.sdk.testing.PAssert$PAssertionSite.capture(PAssert.java:175)
	at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:460)
	at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:452)
	at org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testAfterProcessingTimeContinuationTriggerUsingState(GroupByKeyTest.java:302)

apilloud avatar Oct 17 '22 18:10 apilloud

As much as I want to work on this, that hasn't happened in the last two weeks and I don't see it happening this year so I'm going to unassign it.

apilloud avatar Nov 02 '22 03:11 apilloud