Current CI testing devices

[freedomtan]

check https://github.com/mlcommons/mobile_app_open/blob/master/.github/workflows/android-build-test.yml#L321-L3329-L330C46

[anhappdev]

BrowserStack:

  - backend: "tflite"
    device: "Samsung Galaxy M32-11.0"
  - backend: "pixel"
    device: "Google Pixel 9 Pro-15.0"
  - backend: "qti"
    device: "Samsung Galaxy S24 Ultra-14.0"
  - backend: "samsung"
    device: "Samsung Galaxy S24-14.0"

We lack a device in BrowserStack to test the MTK backend. So for now we use OnePlus DN2103 from Firebase Test Lab. Tested devices for MTK backend:

App: test-main-mtk-414.apk, Device: Google Pixel 7, OS Version: 13.0, Duration: 32s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 6 Pro, OS Version: 13.0, Duration: 31s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 9 Pro XL, OS Version: 15.0, Duration: 29s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 9 Pro, OS Version: 15.0, Duration: 37s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 9, OS Version: 15.0, Duration: 28s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 6 Pro, OS Version: 15.0, Duration: 38s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy S24 Ultra, OS Version: 14.0, Duration: 29s, Status: failed
App: test-main-mtk-414.apk, Device: OnePlus 11R, OS Version: 13.0, Duration: 32s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 8 Pro, OS Version: 14.0, Duration: 75s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 8, OS Version: 14.0, Duration: 30s, Status: failed
App: test-main-mtk-414.apk, Device: OnePlus 12R, OS Version: 14.0, Duration: 36s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy S23 Ultra, OS Version: 13.0, Duration: 34s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy S23, OS Version: 13.0, Duration: 33s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 7 Pro, OS Version: 13.0, Duration: 30s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy S22 Ultra, OS Version: 12.0, Duration: 31s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy S22 Plus, OS Version: 12.0, Duration: 32s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy S22, OS Version: 12.0, Duration: 30s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy S21, OS Version: 12.0, Duration: 35s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 6 Pro, OS Version: 12.0, Duration: 31s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 6, OS Version: 12.0, Duration: 33s, Status: failed
App: test-main-mtk-414.apk, Device: Google Pixel 5, OS Version: 12.0, Duration: 36s, Status: failed
App: test-main-mtk-414.apk, Device: Huawei Nova 11 SE, OS Version: 12.0, Duration: 42s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy Tab S8, OS Version: 12.0, Duration: 26s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy S21 Ultra, OS Version: 11.0, Duration: 32s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy S21, OS Version: 11.0, Duration: 40s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy S21 Plus, OS Version: 11.0, Duration: 36s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy M52, OS Version: 11.0, Duration: 31s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy M32, OS Version: 11.0, Duration: 34s, Status: failed
App: test-main-mtk-414.apk, Device: Samsung Galaxy A52, OS Version: 11.0, Duration: 36s, Status: failed
App: test-main-mtk-414.apk, Device: Xiaomi Redmi Note 11, OS Version: 11.0, Duration: 30s, Status: failed
App: test-main-mtk-414.apk, Device: Vivo Y21, OS Version: 11.0, Duration: 939s, Status: failed
App: test-main-mtk-414.apk, Device: Vivo V21, OS Version: 11.0, Duration: 417s, Status: failed
App: test-main-mtk-414.apk, Device: Oppo Reno 6, OS Version: 11.0, Duration: 456s, Status: failed
App: test-main-mtk-414.apk, Device: Oppo A96, OS Version: 11.0, Duration: 35s, Status: failed
App: test-main-mtk-414.apk, Device: Motorola Moto G71 5G, OS Version: 11.0, Duration: 35s, Status: failed