reference-browser icon indicating copy to clipboard operation
reference-browser copied to clipboard

Intermittent UI test failure - < MediaPlaybackTest.videoPlaybackTest>

Open AndiAJ opened this issue 3 years ago • 6 comments

Firebase Test Run: Firebase link

Stacktrace:

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=com.android.systemui:id/notification_stack_scroller] at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:417) at androidx.test.uiautomator.UiScrollable.scrollForward(UiScrollable.java:398) at org.mozilla.reference.browser.ui.robots.NotificationRobot.verifySystemNotificationExists(NotificationRobot.kt:49) at org.mozilla.reference.browser.ui.MediaPlaybackTest$videoPlaybackTest$3.invoke(MediaPlaybackTest.kt:62) at org.mozilla.reference.browser.ui.MediaPlaybackTest$videoPlaybackTest$3.invoke(MediaPlaybackTest.kt:61) at org.mozilla.reference.browser.ui.robots.NotificationRobotKt.notificationShade(NotificationRobot.kt:79) at org.mozilla.reference.browser.ui.MediaPlaybackTest.videoPlaybackTest(MediaPlaybackTest.kt:61) at java.lang.reflect.Method.invoke(Native Method) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at androidx.test.internal.runner.junit4.statement.RunBefores.evaluate(RunBefores.java:80) at androidx.test.internal.runner.junit4.statement.RunAfters.evaluate(RunAfters.java:61) at androidx.test.rule.ActivityTestRule$ActivityStatement.evaluate(ActivityTestRule.java:527) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.ParentRunner.run(ParentRunner.java:413) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.ParentRunner.run(ParentRunner.java:413) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at org.junit.runner.JUnitCore.run(JUnitCore.java:115) at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56) at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:388) at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2189)

Build: 2/5 Master

AndiAJ avatar Feb 07 '22 09:02 AndiAJ

Flaky 1x on 5/23 Main Firebase link

java.lang.RuntimeException: Could not launch intent Intent { act=android.intent.action.MAIN flg=0x10000000 cmp=org.mozilla.reference.browser.debug/org.mozilla.reference.browser.BrowserActivity } within 45000 milliseconds. Perhaps the main thread has not gone idle within a reasonable amount of time? There could be an animation or something constantly repainting the screen. Or the activity is doing network calls on creation? See the threaddump logs. For your reference the last time the event queue was idle before your activity launch request was 1653319310229 and now the last time the queue went idle was: 1653319311180. If these numbers are the same your activity might be hogging the event queue. at androidx.test.runner.MonitoringInstrumentation.startActivitySync(MonitoringInstrumentation.java:509) at androidx.test.rule.ActivityTestRule.launchActivity(ActivityTestRule.java:354) at androidx.test.rule.ActivityTestRule$ActivityStatement.evaluate(ActivityTestRule.java:525) at org.mozilla.reference.browser.helpers.RetryTestRule$apply$$inlined$statement$1.evaluate(RetryTestRule.kt:48) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.ParentRunner.run(ParentRunner.java:413) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.ParentRunner.run(ParentRunner.java:413) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at org.junit.runner.JUnitCore.run(JUnitCore.java:115) at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56) at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:444) at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2205)

AndiAJ avatar May 24 '22 10:05 AndiAJ

Flaky 1x on 6/23 Main Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=org.mozilla.reference.browser.debug:id/mozac_browser_toolbar_url_view] at androidx.test.uiautomator.UiObject.click(UiObject.java:416) at org.mozilla.reference.browser.ui.robots.NavigationToolbarRobot$Transition.enterUrlAndEnterToBrowser(NavigationToolbarRobot.kt:41) at org.mozilla.reference.browser.ui.MediaPlaybackTest.videoPlaybackTest(MediaPlaybackTest.kt:62)

AndiAJ avatar Jun 24 '22 06:06 AndiAJ

Failed on 7/17 Main with an ANR: https://console.firebase.google.com/project/moz-reference-browser-230023/testlab/histories/bh.b4e77beaed81bc1c/matrices/5151546345543713176/executions/bs.fc423d8654604355

sv-ohorvath avatar Jul 18 '22 13:07 sv-ohorvath

Failed 1x on 8/4 Main Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=org.mozilla.reference.browser.debug:id/mozac_browser_toolbar_url_view] at androidx.test.uiautomator.UiObject.click(UiObject.java:416) at org.mozilla.reference.browser.ui.robots.NavigationToolbarRobot$Transition.enterUrlAndEnterToBrowser(NavigationToolbarRobot.kt:41) at org.mozilla.reference.browser.ui.MediaPlaybackTest.videoPlaybackTest(MediaPlaybackTest.kt:62)

Firebase link

java.lang.RuntimeException: Could not launch intent Intent { act=android.intent.action.MAIN flg=0x10000000 cmp=org.mozilla.reference.browser.debug/org.mozilla.reference.browser.BrowserActivity } within 45000 milliseconds. Perhaps the main thread has not gone idle within a reasonable amount of time? There could be an animation or something constantly repainting the screen. Or the activity is doing network calls on creation? See the threaddump logs. For your reference the last time the event queue was idle before your activity launch request was 1659626147530 and now the last time the queue went idle was: 1659626149181. If these numbers are the same your activity might be hogging the event queue. at androidx.test.runner.MonitoringInstrumentation.startActivitySync(MonitoringInstrumentation.java:509) at androidx.test.rule.ActivityTestRule.launchActivity(ActivityTestRule.java:354) at androidx.test.rule.ActivityTestRule$ActivityStatement.evaluate(ActivityTestRule.java:525) at org.mozilla.reference.browser.helpers.RetryTestRule$apply$$inlined$statement$1.evaluate(RetryTestRule.kt:48) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.ParentRunner.run(ParentRunner.java:413) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.ParentRunner.run(ParentRunner.java:413) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at org.junit.runner.JUnitCore.run(JUnitCore.java:115) at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56) at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:444) at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2205)

AndiAJ avatar Aug 05 '22 13:08 AndiAJ

Closing, as it didn't fail recently.

AndiAJ avatar Nov 09 '22 14:11 AndiAJ

Flaky 1x on 5/2 Main Firebase link

androidx.test.uiautomator.UiObjectNotFoundException: UiSelector[RESOURCE_ID=org.mozilla.reference.browser.debug:id/mozac_browser_toolbar_url_view] at androidx.test.uiautomator.UiObject.click(UiObject.java:416) at org.mozilla.reference.browser.ui.robots.NavigationToolbarRobot$Transition.enterUrlAndEnterToBrowser(NavigationToolbarRobot.kt:41) at org.mozilla.reference.browser.ui.MediaPlaybackTest.videoPlaybackTest(MediaPlaybackTest.kt:62)

AndiAJ avatar May 03 '23 13:05 AndiAJ