nowinandroid icon indicating copy to clipboard operation
nowinandroid copied to clipboard

Run Android tests on FTL managed device

Open AndreSand opened this issue 2 years ago • 5 comments

Run Android test on Firebase test lab device. Run time: ~19mins. Gradle tasks: $./gradlew app:myFtlDeviceDemoDebugAndroidTest

Android Studio Hedgehog | 2023.1.1 Canary 14

TODO:

  • Add the workflow Ftl.yaml
  • Add service account JSON file to Gtihub secrets

AndreSand avatar Oct 05 '23 00:10 AndreSand

Let's mark this PR as a draft PR if it's not ready for review.

JoseAlcerreca avatar Oct 05 '23 10:10 JoseAlcerreca

Is there a specific rational behind using a dedicated workflow instead of merging this into Build.yaml?

SimonMarquis avatar Oct 05 '23 11:10 SimonMarquis

Is there a specific rational behind using a dedicated workflow instead of merging this into Build.yaml?

No specific reason, just to make the CI faster

AndreSand avatar Oct 05 '23 23:10 AndreSand

This could still be merged into the Build.yaml without any dependency, like what the test job does:

https://github.com/android/nowinandroid/blob/a77d7b69b58238e2b5e934ab9e492c0932bf2904/.github/workflows/Build.yaml#L52

You said the run time was 19mins. Is it only the test execution time, or did you include the compilation time as well? Did you experimented with sharding (this could improve the test execution time).

SimonMarquis avatar Oct 06 '23 07:10 SimonMarquis

By the way, this PR currently only runs instrumented tests from the :app module (26 tests) and not the full test suite.

SimonMarquis avatar Oct 06 '23 08:10 SimonMarquis