cua icon indicating copy to clipboard operation
cua copied to clipboard
Published 4 days ago • verified publisher icon trycua

[Agent] MCP Improvements (UITARS and image support)

Open ddupont808 opened this issue 8 months ago • 0 comments

Fixed:

  • Fixed agent trajectories sometimes missing the text & reasoning in the tool call results

Added:

  • screenshot_cua tool so an MCP agent can observe the VM state before executing tasks
  • UITARS loop to MCP server
  • Screenshots in MCP tool call results
  • MCP Development guide in mcp-server/README.md

ddupont808 avatar May 01 '25 00:05 ddupont808