python-client
python-client copied to clipboard
[CI] Fix android functional tests on CI with SDK 30.
The problem
After upgrading to Android SDK 30, many tests are failed on CI. But almost tests which is failed on CI are passed in local env. (Same device env to CI)
Notes
- 26TC failed on CI (with Android SDK v30)
- https://dev.azure.com/AppiumCI/Appium%20CI/_build/results?buildId=13654&view=ms.vss-test-web.build-test-results-tab
- (ref) XTC failed at emulator in local env (AndroidR(SDK30), Nexus 6)
ERROR functional/android/chrome_tests.py::TestChrome::test_find_single_element - selenium.common.exceptions.WebDriverException: Message: An unknown...
FAILED functional/android/activities_tests.py::TestActivities::test_start_activity_other_app - selenium.common.exceptions.WebDriverException: Messa...
FAILED functional/android/activities_tests.py::TestActivities::test_start_activity_other_app - selenium.common.exceptions.WebDriverException: Messa...
FAILED functional/android/common_tests.py::TestCommon::test_open_notifications - Failed: DID NOT RAISE <class 'selenium.common.exceptions.NoSuchEle...
3 failed, 54 passed, 7 skipped, 1 error in 968.46s (0:16:08)
- (ref) 8TC failed at real device (AndroidR(SDK30), Mi10)
FAILED functional/android/activities_tests.py::TestActivities::test_start_activity_other_app - selenium.common.exceptions.WebDriverException: Messa...
FAILED functional/android/activities_tests.py::TestActivities::test_start_activity_other_app - selenium.common.exceptions.WebDriverException: Messa...
FAILED functional/android/applications_tests.py::TestApplications::test_app_strings - KeyError: 'monkey_wipe_data'
FAILED functional/android/chrome_tests.py::TestChrome::test_find_single_element - selenium.common.exceptions.WebDriverException: Message: An unknow...
FAILED functional/android/common_tests.py::TestCommon::test_open_notifications - Failed: DID NOT RAISE <class 'selenium.common.exceptions.NoSuchEle...
FAILED functional/android/finger_print_tests.py::TestFingerPrint::test_finger_print - selenium.common.exceptions.WebDriverException: Message: An un...
FAILED functional/android/hw_actions_tests.py::TestHwActions::test_lock - assert False
FAILED functional/android/touch_action_tests.py::TestTouchAction::test_long_press_x_y - selenium.common.exceptions.TimeoutException: Message:
I've also noticed that API30+ emulator is slower in Azure env in comparison to older ones.