UI-TARS icon indicating copy to clipboard operation
UI-TARS copied to clipboard

fails to output coordinates

Open Cescfangs opened this issue 9 months ago • 4 comments

Hey, I found ui-tars-7b-dpo model frequently not follow instructions and fails to output specific coordinates, like this:

Action: click(start_box='=')

I used the recommended prompt for computer

Cescfangs avatar Mar 06 '25 03:03 Cescfangs

Hi, does it happen frequently? We did observe that the model output such illegal action pattern occasionally, and we are fixing this.

pooruss avatar Mar 07 '25 03:03 pooruss

same bug at ui-tars-72b-dpo, and it happen frequently.

yikangshao avatar Mar 07 '25 06:03 yikangshao

你好,这种情况经常发生吗?我们确实观察到模型偶尔会输出这种非法行为模式,我们正在修复这个问题。

Has it been resolved? I also encountered the same problem, after asking the same question multiple times in a row, it would output a bunch of "="

xumeng19 avatar Mar 10 '25 13:03 xumeng19

Hi, this phenomenon has been alleviated significantly in our latest model ui-tars-1.5-7b. Feel free to give it a try and share your feedback!

pooruss avatar May 01 '25 14:05 pooruss