UI-TARS icon indicating copy to clipboard operation
UI-TARS copied to clipboard
verified publisher icon bytedance

Bug: UI-TARS element locator outputs incorrect coordinates on some pages

Open QuantumAlchemist03 opened this issue 8 months ago • 3 comments

When using the UI-TARS-1.5-7B model to locate elements on certain webpages, the predicted coordinates are significantly off. This affects downstream tasks that depend on accurate UI element location.

QuantumAlchemist03 avatar Apr 25 '25 08:04 QuantumAlchemist03

I have the same problem.

woxima avatar Apr 25 '25 09:04 woxima

+1

NEOOOOOOOOOO avatar Apr 28 '25 08:04 NEOOOOOOOOOO

Please refer to this tutorial for coordinate conversion. If you still encounter issues, feel free to provide a specific example.

JjjFangg avatar Apr 29 '25 14:04 JjjFangg

Please refer to this tutorial for coordinate conversion. If you still encounter issues, feel free to provide a specific example.

Image

jyxu2015 avatar May 15 '25 08:05 jyxu2015