We found 10 flaky test

[shaker-project]

Hello, we are a group of researchers that investigate the occurrence of flaky tests in Android.

We voluntarily ran your GUI tests 12 times and found that some tests pass or fail non-deterministically, which characterizes them as flaky tests [1]. Below we list each flaky test we found, and its number of failures.

• test005EditMode - failed 10 times (stack trace)
• test008Delete - failed 8 times (stack trace)
• test002NocodeScanned - failed 2 times (stack trace)
• test003AddCodes - failed 2 times (stack trace)
• test003CodesChange - failed 2 times (stack trace)
• test004Rearrange - failed 5 times (stack trace)
• test005RenameCancel - failed 3 times (stack trace)
• test006Rename - failed 3 times (stack trace)
• test007DeleteCancel - failed 2 times (stack trace)
• test001InvalidQRCode - failed 1 time (stack trace)

We ran these tests on a generic Android Emulator (AVD) with Android API version 28.

If you confirm this behavior, our suggestion is to add the @FlakyTest annotation on these tests. See https://developer.android.com/reference/androidx/test/filters/FlakyTest

If you wish for a repair proposal, please let us know.

[1] https://hackernoon.com/flaky-tests-a-war-that-never-ends-9aa32fdef359

Graciously, Denini, Leopoldo and Marcelo.