mobile_app_open
mobile_app_open copied to clipboard
For V4.0
- [x] new model: the model should be public before code freeze? Check with @colbybanbury this week. #722, #853, #821
- [x] loadgen: https://github.com/mlcommons/mobile_app_open/pull/798
- [x] UI update: https://github.com/mlcommons/mobile_app_open/issues/806
- [x] random number seed from the mail inference group once they are available. it's in https://github.com/mlcommons/inference/pull/1560/files#diff-4aea9ab8b222eed4a7096c6707e8e37682594dcb485d9b7450ad1b2e7155a853. We need to change the setting in the app. https://github.com/mlcommons/mobile_app_open/pull/863
- [x] Change the order of the test cases. in #722
Let's branch out v4_0, and try to add the three things above.
~https://github.com/mlcommons/mobile_app_open/tree/submission-v.40~
Update (2024-02-06): There is a typo in the branch name, so I created a new one here: https://github.com/mlcommons/mobile_app_open/tree/submission-v4.0
I think We need to reorder the test cases. Based on the past, the outgoing test cases should be put toward the end of the list i think.
the order should be
- IC V2
- OD
- IS V2
- LU
- SR
- IC V2 offline
- IC
- IC offline
Thanks @anhappdev for merging all the necessary patches into the submission-v4.0 branch.
@mohitmundhragithub and @AhmedTElthakeb Please help check if it is OK https://github.com/mlcommons/mobile_app_open/tree/submission-v4.0
Thanks @anhappdev for merging all the necessary patches into the submission-v4.0 branch.
@mohitmundhragithub and @AhmedTElthakeb Please help check if it is OK https://github.com/mlcommons/mobile_app_open/tree/submission-v4.0
we tried it out. Everything looks ok to me.
- [x] mediatek
- [x] qualcomm
- [x] samsung: it should be fine. need check again. @AhmedTElthakeb to confirm it.
Looks ok to me