mobile_app_open icon indicating copy to clipboard operation
mobile_app_open copied to clipboard

For V4.0

Open freedomtan opened this issue 1 year ago • 7 comments

  • [x] new model: the model should be public before code freeze? Check with @colbybanbury this week. #722, #853, #821
  • [x] loadgen: https://github.com/mlcommons/mobile_app_open/pull/798
  • [x] UI update: https://github.com/mlcommons/mobile_app_open/issues/806
  • [x] random number seed from the mail inference group once they are available. it's in https://github.com/mlcommons/inference/pull/1560/files#diff-4aea9ab8b222eed4a7096c6707e8e37682594dcb485d9b7450ad1b2e7155a853. We need to change the setting in the app. https://github.com/mlcommons/mobile_app_open/pull/863
  • [x] Change the order of the test cases. in #722

freedomtan avatar Jan 16 '24 06:01 freedomtan

Let's branch out v4_0, and try to add the three things above.

freedomtan avatar Jan 30 '24 06:01 freedomtan

~https://github.com/mlcommons/mobile_app_open/tree/submission-v.40~

Update (2024-02-06): There is a typo in the branch name, so I created a new one here: https://github.com/mlcommons/mobile_app_open/tree/submission-v4.0

anhappdev avatar Feb 01 '24 03:02 anhappdev

I think We need to reorder the test cases. Based on the past, the outgoing test cases should be put toward the end of the list i think.

the order should be

  1. IC V2
  2. OD
  3. IS V2
  4. LU
  5. SR
  6. IC V2 offline
  7. IC
  8. IC offline

mohitmundhragithub avatar Feb 28 '24 09:02 mohitmundhragithub

Thanks @anhappdev for merging all the necessary patches into the submission-v4.0 branch.

@mohitmundhragithub and @AhmedTElthakeb Please help check if it is OK https://github.com/mlcommons/mobile_app_open/tree/submission-v4.0

freedomtan avatar Mar 06 '24 01:03 freedomtan

Thanks @anhappdev for merging all the necessary patches into the submission-v4.0 branch.

@mohitmundhragithub and @AhmedTElthakeb Please help check if it is OK https://github.com/mlcommons/mobile_app_open/tree/submission-v4.0

we tried it out. Everything looks ok to me.

mohitmundhragithub avatar Mar 11 '24 09:03 mohitmundhragithub

  • [x] mediatek
  • [x] qualcomm
  • [x] samsung: it should be fine. need check again. @AhmedTElthakeb to confirm it.

freedomtan avatar Mar 12 '24 05:03 freedomtan

Looks ok to me

AhmedTElthakeb avatar Mar 13 '24 21:03 AhmedTElthakeb