Anh

Yes. The extended test passed: https://github.com/mlcommons/mobile_app_open/actions/runs/17875525054

> Shall we use this commit for the release? [0e726d8](https://github.com/mlcommons/mobile_app_open/commit/0e726d86f125515ddfde62c3f72f6b71c96ac804) Yes, it should be the latest version with the correct app version. In that case, please also test the corresponding...

https://github.com/mlcommons/mobile_app_open/releases/tag/v5.0.2

@Mostelk Do you have a crash report or log? Also, what is the Android version on those devices?

Maybe related: - https://github.com/mlcommons/mobile_app_open/issues/1074

@farook-edev Can you please share the dataset? So I can upload it to our CDN so that the app can download it automatically.

@farook-edev Thank you. Here are the public URLs: https://mobile.mlcommons-storage.org/app-resources/datasets/v6_0/llama3_1b.spm.model https://mobile.mlcommons-storage.org/app-resources/datasets/v6_0/tiny33_ifeval.tfrecord https://mobile.mlcommons-storage.org/app-resources/datasets/v6_0/tinymmlu.tfrecord ``` MD5 (llama3_1b.spm.model) = 2ad260fc18b965ce16006d76c9327082 MD5 (tiny33_ifeval.tfrecord) = 147806b0d2cb0c4329d0901939f62c1c MD5 (tinymmlu.tfrecord) = c20f9115582217af15e4d9955b41ace1 ```

I think 2 separate benchmarks is a good choice.

> [@anhappdev](https://github.com/anhappdev) could you please upload this model to the CDN? > > https://drive.google.com/file/d/1cd06WLDIW7QSZVI4_9o7iAjmNl0VdHM7/view?usp=sharing > > Thanks! @farook-edev Yes. Here is the link: https://mobile.mlcommons-storage.org/app-resources/models/v6_0/tflite/llama_q8_ekv3072.tflite