MobileAgent icon indicating copy to clipboard operation
MobileAgent copied to clipboard

Published 20 hours ago • verified publisher icon X-PLUG

How are the metrics in mobileAgentE evaluated?

Open Incredible61 opened this issue 7 months ago • 1 comments

Hi, I wonder in the code of mobileAgentE, where are the evaluation metrics in the experimental part of the paper implemented? Or are these metrics calculated manually? I didn't find the relative code in MobileAgentE.

Incredible61 avatar Apr 09 '25 12:04 Incredible61

Hello. The evaluation results of Mobile-Agent-E are all manually calculated. The specific calculation method of each metric is in the paper. You can use the saved operation traces to calculate these metrics step by step.

junyangwang0410 avatar Apr 14 '25 02:04 junyangwang0410