AppAgent
AppAgent copied to clipboard
mnotgod96
AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.
Which element do you want to tap? Choose a numeric tag from 1 to 13: 1 Choose one of the following actions you want to perform on the current screen:...
 如图所示，理论上这时候应该出现指示：choose one of the following actions you want to perform at the current screen: tap , text , long press, swipe, stop 但是没有出现。 手机屏幕的截图是出来了，如图所示 
部分页面在生成标签图时报错Command execution failed: adb -s b2596f0e pull /storage/emulated/0/demo_zhuanzhuan0001_2024-03-05_15-39-43_2.xml ./apps\zhuanzhuan0001\demos\demo_zhuanzhuan0001_2024-03-05_15-39-43\xml\demo_zhuanzhuan0001_2024-03-05_15-39-43_2.x ml
执行前无报错退出（小概率不退出但是terminal卡死  执行初始化时无报错退出与terminal卡死  执行到一半无报错退出（可能是demo phase结束后，也可能是自由探索的任何一轮对话之后  请问这种不稳定性可能是什么导致的
If I want the script to display an error when the element corresponding to the tag has been changed or does not exist, is there any good way to do...
Can the model make assertions about the page? Just like doing ui automation testing, the core is to assert the presence or absence of elements
Hello, Have been testing this but there is little lag or i can say slow while it operates even after the learning part is there any plan for improving the...
代码下的是最新的通义千问的，Python版本号为3.11.5，手机也创建了2个文件夹 报错内容如下： C:\Users\sunbin\AppData\Local\Programs\Python\Python311\python.exe C:\Users\sunbin\Desktop\AppAgent-main\learn.py Warning! No module named 'sounddevice' Warning! No module named 'matplotlib' Warning! No module named 'keras' Welcome to the exploration phase of AppAgent! The exploration phase aims...