fenix icon indicating copy to clipboard operation
fenix copied to clipboard
verified publisher icon mozilla-mobile

Intermittent UI test failure - < SettingsPrivacyTest. deleteCookiesTest >

Open AndiAJ opened this issue 3 years ago • 7 comments

Firebase Test Run: Firebase link

Stacktrace:

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:648) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:645) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:645)

Build: 8/29 Main

┆Issue is synchronized with this Jira Task

AndiAJ avatar Aug 30 '22 08:08 AndiAJ

Flaky 1x on 9/15 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:636) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:635) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:635)

AndiAJ avatar Sep 15 '22 11:09 AndiAJ

Flaky 3x on 9/16 Main Firebase link

Firebase link

Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:631) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:630) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:630)

AndiAJ avatar Sep 16 '22 13:09 AndiAJ

Flaky 1x on 9/16 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:631) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:630) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:630)

AndiAJ avatar Sep 19 '22 07:09 AndiAJ

Flaky 1x on 9/20 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:630) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:629) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:629)

AndiAJ avatar Sep 20 '22 09:09 AndiAJ

Flaky 1x on 9/21 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:630) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:629) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:629)

AndiAJ avatar Sep 21 '22 11:09 AndiAJ

Flaky 1x on 9/22 Main Firebase link

AaronMT avatar Sep 23 '22 04:09 AaronMT

Flaky 1x on 9/23 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:630) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:629) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:629)

AndiAJ avatar Sep 23 '22 11:09 AndiAJ

Flaky 1x on 9/27 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:630) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:629) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:629)

AndiAJ avatar Sep 28 '22 07:09 AndiAJ

Flaky 1x on 10/3 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:620) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:619) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:619)

AndiAJ avatar Oct 04 '22 11:10 AndiAJ

Flaky 1x on 10/5 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:620) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:619) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:619)

AndiAJ avatar Oct 05 '22 13:10 AndiAJ

Flaky 1x on 10/11 Main Firebase link

https://console.firebase.google.com/u/0/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/8545463452083292429/executions/bs.2de9ad47cab85aba/testcases/3/test-cases

AndiAJ avatar Oct 11 '22 10:10 AndiAJ

Flaky 1x on 10/13 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:102) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:620) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:619) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:109) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:619)

AndiAJ avatar Oct 13 '22 12:10 AndiAJ

Flaky 1x on 10/18 Main Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:103) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:620) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:619) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:111) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:619)

AndiAJ avatar Oct 19 '22 12:10 AndiAJ

Flaky 2x on 10/19 Main Firebase link

Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:103) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:620) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:619) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:111) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:619)

AndiAJ avatar Oct 20 '22 08:10 AndiAJ

Flaky 2x on 10/20 Main Firebase link Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:103) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:620) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:619) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:111) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:619)

AndiAJ avatar Oct 21 '22 13:10 AndiAJ

Flaky 1x on 10/29 Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:108) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:620) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:619) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:138) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:619)

Flaky 1x on 10/30 Firebase link

java.lang.AssertionError: Page didn't load or doesn't contain the expected text at org.junit.Assert.fail(Assert.java:89) at org.junit.Assert.assertTrue(Assert.java:42) at org.mozilla.fenix.ui.robots.BrowserRobot.verifyPageContent(BrowserRobot.kt:108) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:620) at org.mozilla.fenix.ui.SettingsPrivacyTest$deleteCookiesTest$2.invoke(SettingsPrivacyTest.kt:619) at org.mozilla.fenix.ui.robots.NavigationToolbarRobot$Transition.enterURLAndEnterToBrowser(NavigationToolbarRobot.kt:138) at org.mozilla.fenix.ui.SettingsPrivacyTest.deleteCookiesTest(SettingsPrivacyTest.kt:619)

AndiAJ avatar Oct 31 '22 09:10 AndiAJ

10/02 https://console.firebase.google.com/u/0/project/moz-fenix/testlab/histories/bh.66b7091e15d53d45/matrices/8407606236277628803

AaronMT avatar Nov 02 '22 13:11 AaronMT