OpenAdapt icon indicating copy to clipboard operation
OpenAdapt copied to clipboard
Published 3 months ago • verified publisher icon OpenAdaptAI

Implement CoordinateReplayStrategy with Claude/UGround/Omniparser

Open abrichr opened this issue 1 year ago • 0 comments

Feature request

We would like to implement a new replay strategy that directly extracts and generates target element coordinates using https://docs.anthropic.com/en/docs/build-with-claude/computer-use and/or https://github.com/OpenAdaptAI/OpenAdapt/issues/880 and/or https://github.com/OpenAdaptAI/OpenAdapt/issues/894.

Motivation

Robustness, speed

abrichr avatar Oct 24 '24 15:10 abrichr