fenix icon indicating copy to clipboard operation
fenix copied to clipboard

Tracking UI Tests disabled with frequent ANR [API 30]

Open AaronMT opened this issue 2 years ago • 8 comments

See: https://github.com/mozilla-mobile/fenix/issues/24047 See: https://bugzilla.mozilla.org/show_bug.cgi?id=1764605

The following tests were disabled to land API30 work as they were frequently hitting ANRs in the Client on Firebase.

  • mediaSystemNotificationInPrivateModeTest
  • launchLinksInPrivateToggleOffStateDoesntChangeTest
  • testStrictVisitDisableExceptionToggle
  • homeThreeDotMenuItemsTest
  • testSignInPageWithNoNetworkConnection

┆Issue is synchronized with this Jira Task

AaronMT avatar Apr 27 '22 15:04 AaronMT

Ran all the 5 disable tests and learned the following from the logs:

testSignInPageWithNoNetworkConnection - test run to completion and afterwards it fails due to the ANR • homeThreeDotMenuItemsTest - The last performed action was to close the "What's new" tab mediaSystemNotificationInPrivateModeTest - The last performed action was to close the private media tab testStrictVisitDisableExceptionToggle - The last performed action was to open the protection settings launchLinksInPrivateToggleOffStateDoesntChangeTest - The last performed action was to search and open the home screen shortcut

AndiAJ avatar Apr 28 '22 14:04 AndiAJ

verifyContextMixedVariations got disabled today in #25277

AndiAJ avatar May 18 '22 12:05 AndiAJ

audioPlaybackSystemNotificationTest got disabled today in #25343

AndiAJ avatar May 23 '22 10:05 AndiAJ

videoPlaybackSystemNotificationTest hit this crash too (currently disabled).

sv-ohorvath avatar Jun 02 '22 13:06 sv-ohorvath

verifyAboutFirefoxPreview got disabled today in #25694

AndiAJ avatar Jun 21 '22 10:06 AndiAJ

testDownloadPrompt got disabled today in #26266

AndiAJ avatar Aug 01 '22 10:08 AndiAJ

mainMenuOpenInAppTestgot disabled today in #26317

AndiAJ avatar Aug 04 '22 13:08 AndiAJ

Re-enabled in #27058 testDownloadPrompt testSignInPageWithNoNetworkConnection launchLinksInPrivateToggleOffStateDoesntChangeTest

AndiAJ avatar Sep 20 '22 08:09 AndiAJ

verifyAboutFirefoxPreview re-enabled in #27134 videoPlaybackSystemNotificationTest re-enabled in #27060 mediaSystemNotificationInPrivateModeTest re-enabled in #27060 mainMenuOpenInAppTest re-enabled in #27060 verifyContextMixedVariations re-enabled in #27060 homeThreeDotMenuItemsTest re-enabled in #27060 audioPlaybackSystemNotificationTest re-enabled in #27060 testStrictVisitDisableExceptionToggle re-enabled in #27060

AndiAJ avatar Sep 27 '22 14:09 AndiAJ