AppAgent icon indicating copy to clipboard operation
AppAgent copied to clipboard
verified publisher icon mnotgod96

Questions about the content of the task and the amount of documentation

Open kig1929 opened this issue 2 years ago • 2 comments

I am interested in your research and thank you for sharing your project! I have some questions about AppAgent.

  1. Could you share a list of 50 tasks over 10 apps from the paper? I think it would be helpful for others to know the details of this study if the entire process was disclosed with the exception of the demo.
  2. How many documents were generated for each task during the exploration phase? I want to know how much exploration is needed to be used meaningfully.

kig1929 avatar Jan 24 '24 12:01 kig1929

hi, thanks for your interest. we are going to release a more comprehensive benchmark with more apps and tasks in the future. please look forward to it.

icoz69 avatar Jan 25 '24 08:01 icoz69

Could you give me a rough estimate of when that might be?

kig1929 avatar Jan 25 '24 09:01 kig1929

hi, we have updated the tasks we evaluated in : https://github.com/mnotgod96/AppAgent/blob/main/assets/testset.md

icoz69 avatar Jan 31 '24 02:01 icoz69

Thanks for sharing:)

kig1929 avatar Feb 13 '24 07:02 kig1929