kop icon indicating copy to clipboard operation
kop copied to clipboard

Flaky-test: UpgradeTest.testConsumeLatest

Open Demogorgon314 opened this issue 3 years ago • 1 comments

UpgradeTest is flaky. The testConsumeLatest test method fails sporadically.

example failure

Error:  testConsumeLatest(io.streamnative.pulsar.handlers.kop.UpgradeTest)  Time elapsed: 4.365 s  <<< FAILURE!
java.lang.AssertionError: lists don't have the same size expected [1] but found [0]
	at org.testng.Assert.fail(Assert.java:96)
	at org.testng.Assert.failNotEquals(Assert.java:776)
	at org.testng.Assert.assertEqualsImpl(Assert.java:137)
	at org.testng.Assert.assertEquals(Assert.java:118)
	at org.testng.Assert.assertEquals(Assert.java:652)
	at org.testng.Assert.assertEquals(Assert.java:819)
	at org.testng.Assert.assertEquals(Assert.java:796)
	at io.streamnative.pulsar.handlers.kop.UpgradeTest$TestTopic.testConsumeLatest(UpgradeTest.java:218)
	at io.streamnative.pulsar.handlers.kop.UpgradeTest.testConsumeLatest(UpgradeTest.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
	at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:54)
	at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:44)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:[266](https://github.com/streamnative/kop/runs/5858286648?check_suite_focus=true#step:5:266))
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)

Demogorgon314 avatar Apr 07 '22 00:04 Demogorgon314

Another failure

Error:  Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 45.86 s <<< FAILURE! - in io.streamnative.pulsar.handlers.kop.UpgradeTest
Error:  testConsumeLatest(io.streamnative.pulsar.handlers.kop.UpgradeTest)  Time elapsed: 3.654 s  <<< FAILURE!
java.lang.AssertionError: lists don't have the same size expected [1] but found [0]
	at org.testng.Assert.fail(Assert.java:96)
	at org.testng.Assert.failNotEquals(Assert.java:776)
	at org.testng.Assert.assertEqualsImpl(Assert.java:137)
	at org.testng.Assert.assertEquals(Assert.java:118)
	at org.testng.Assert.assertEquals(Assert.java:652)
	at org.testng.Assert.assertEquals(Assert.java:819)
	at org.testng.Assert.assertEquals(Assert.java:796)
	at io.streamnative.pulsar.handlers.kop.UpgradeTest$TestTopic.testConsumeLatest(UpgradeTest.java:218)
	at io.streamnative.pulsar.handlers.kop.UpgradeTest.testConsumeLatest(UpgradeTest.java:103)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
	at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:54)
	at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:44)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:[113](https://github.com/streamnative/kop/actions/runs/4353484350/jobs/7607582505#step:13:114)6)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:833)

Demogorgon314 avatar Mar 07 '23 13:03 Demogorgon314