focus-android icon indicating copy to clipboard operation
focus-android copied to clipboard

Investigate permanent UI test failure EnhancedTrackingProtectionSettingsTest#blockSocialTrackersTest

Open AaronMT opened this issue 2 years ago • 3 comments

Firebase Test Lab Run (10/06): here

java.lang.AssertionError
	at org.junit.Assert.fail(Assert.java:87)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.junit.Assert.assertTrue(Assert.java:53)
	at org.mozilla.focus.activity.robots.BrowserRobot.verifyTrackingProtectionAlert(BrowserRobot.kt:57)
	at org.mozilla.focus.activity.EnhancedTrackingProtectionSettingsTest$blockSocialTrackersTest$4.invoke(EnhancedTrackingProtectionSettingsTest.kt:180)
	at org.mozilla.focus.activity.EnhancedTrackingProtectionSettingsTest$blockSocialTrackersTest$4.invoke(EnhancedTrackingProtectionSettingsTest.kt:179)
	at org.mozilla.focus.activity.robots.SearchRobot$Transition.loadPage(SearchRobot.kt:101)
	at org.mozilla.focus.activity.EnhancedTrackingProtectionSettingsTest.blockSocialTrackersTest(EnhancedTrackingProtectionSettingsTest.kt:179)

Based on testing locally, the alert never shows. Not sure if it's a JavaScript page logic issue or a change in social tracker blocking behaviour.

AaronMT avatar Oct 06 '22 17:10 AaronMT

FWIW, I reran a previously-green job and it also started failing, which makes me suspect something external to us changed.

rvandermeulen avatar Oct 06 '22 17:10 rvandermeulen

Social trackers: https://social-track-digest256.dummytracker.org/test_not_blocked.png https://not-a-tracker.dummytracker.org/test_blocked.png

AaronMT avatar Oct 06 '22 17:10 AaronMT

Most likely caused by https://github.com/mozilla-mobile/focus-android/issues/7821

AndiAJ avatar Oct 07 '22 12:10 AndiAJ

Moving here the other ETP tests disabled for the same reason, so I can close the other issues as duplicates: blockOtherContentTrackersTest blockAdTrackersTest blockAnalyticsTrackersTest

sv-ohorvath avatar Nov 21 '22 11:11 sv-ohorvath

Moved to bugzilla: https://bugzilla.mozilla.org/show_bug.cgi?id=1802607

Change performed by the Move to Bugzilla add-on.

cpeterso avatar Nov 25 '22 23:11 cpeterso