Transportr icon indicating copy to clipboard operation
Transportr copied to clipboard

We found 1 tests flaky

Open shaker-project opened this issue 4 years ago • 0 comments

Describe the bug

Hello, we are a group of researchers that investigate the occurrence of flaky tests in Android.

We voluntarily ran your GUI tests 12 times and found that a test pass or fail non-deterministically, which characterizes a flaky test [1]. Below we list the flaky test we found, and its number of failures.

  • searchLocationShowDeparturesTest - failed 1 time (stack trace).

If you confirm this behavior, our suggestion is to add the @FlakyTest annotation on these tests. See https://developer.android.com/reference/androidx/test/filters/FlakyTest

If you wish for a repair proposal, please let us know.

[1] https://hackernoon.com/flaky-tests-a-war-that-never-ends-9aa32fdef359

Versions (please complete the following information):

  • Transportr Version: 2.0.1 We ran these tests on a generic Android Emulator (AVD) with Android API version 28.

Graciously, Denini, Leopoldo and Marcelo.

shaker-project avatar Nov 13 '20 18:11 shaker-project