UI-TARS icon indicating copy to clipboard operation
UI-TARS copied to clipboard

Error 404 with UI-tars desktop 1.5

Open DKeAlvaro opened this issue 8 months ago • 7 comments

Im getting error 404 when using UI-tars 1.5, desktop version, after deploying a huggingface endpoint as explained in:

https://github.com/bytedance/UI-TARS/blob/main/README_deploy.md

error can be seen here: Image

Here you can see the config I used:

Image

For the model name I also used ByteDance-Seed/UI-TARS-1.5-7B

And the api key is a newly generated one from HF with write permisions in all repos

DKeAlvaro avatar Apr 20 '25 17:04 DKeAlvaro

I have the same issueeeeee

DKeAlvaro avatar Apr 20 '25 18:04 DKeAlvaro

Could you show the Report Settings on Settings page,the default value maybe cause connectivity problems

ZhaoHeh avatar Apr 21 '25 03:04 ZhaoHeh

Could you show the Report Settings on Settings page,the default value maybe cause connectivity problems

Hello, both the Report storage Base URL and UTIO Base URL are empty. What should I add there?

I didn't see anything about these fields in the quick start or deployment guide

DKeAlvaro avatar Apr 21 '25 13:04 DKeAlvaro

I am having the same error

Image

boraturant avatar May 07 '25 09:05 boraturant

@boraturant Would you please specify your os? You can check your operation referring to deployment tutorial.

Taoran-Lu avatar May 07 '25 09:05 Taoran-Lu

mac

setup is ok. Both the uitars-desktop and and the below cli command fails with the 404 no body error.

npx @ui-tars/cli start -t adb -q "Help me launch tiktok"

[GUIAgent] run: system prompt: You are a GUI agent. You are given a task and your action history, with screenshots. You need to perform the next action to complete the task.

Output Format

Thought: ... Action: ...

Action Space click(start_box='[x1, y1, x2, y2]') type(content='') swipe(start_box='[x1, y1, x2, y2]', end_box='[x3, y3, x4, y4]') scroll(start_box='[x1, y1, x2, y2]', direction='down or up or right or left') # You must spesify the start_box hotkey(key='') # The available keys: enter,back,home,backspace,delete,menu,power,volume_up,volume_down,mute,lock wait() #Sleep for 2s and take a screenshot to check for any changes. press_home() # Press the home key finished() call_user() # Submit the task and call the user when the task is unsolvable, or when you need the user's help.

Note

  • Write a small plan and finally summarize your next action (with its target element) in one sentence in Thought part.

User Instruction , model version: undefined, model config: {"modelConfig":{"baseURL":" https://g1gb50gcbzpf9e2e.us-east-1.aws.endpoints.huggingface.cloud","apiKey":"hf_deletedthis,”model":"xxx"}} [GUIAgent] loopCnt: 0 [UITarsModel] invoke: screenContext={"width":1080,"height":2340}, scaleFactor=1, uiTarsVersion=undefined [UITarsModel] error NotFoundError: 404 status code (no body) at APIError.generate (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/openai/error.js:54:20) at OpenAI.makeStatusError (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/openai/core.js:299:33) at OpenAI.makeRequest (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/openai/core.js:343:30) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async UITarsModel.invokeModelProvider (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/Model.js:77:24) at async UITarsModel.invoke (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/Model.js:104:24) at async external_async_retry_default.retries._retry_model (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/GUIAgent.js:205:40) at async GUIAgent.run (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/GUIAgent.js:203:59) at async start (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/cli/dist/cli/start.js:161:5) at async Command. (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/cli/dist/cli/commands.js:40:13) { status: 404, headers: { 'access-control-allow-credentials': 'true', 'access-control-allow-origin': '', connection: 'keep-alive', 'content-length': '0', date: 'Wed, 07 May 2025 10:02:21 GMT', vary: 'origin, access-control-request-method, access-control-request-headers, origin, access-control-request-method, access-control-request-headers', 'x-proxied-host': 'http://10.101.38.121', 'x-proxied-path': '/chat/completions', 'x-proxied-replica': '2u4aflr0-4huph', 'x-request-id': 'hfDwe6' }, request_id: 'hfDwe6', error: undefined, code: undefined, param: undefined, type: undefined } [UITarsModel cost]: 1037ms [GUIAgent] run error NotFoundError: 404 status code (no body) at APIError.generate (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/openai/error.js:54:20) at OpenAI.makeStatusError (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/openai/core.js:299:33) at OpenAI.makeRequest (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/openai/core.js:343:30) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async UITarsModel.invokeModelProvider (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/Model.js:77:24) at async UITarsModel.invoke (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/Model.js:104:24) at async external_async_retry_default.retries._retry_model (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/GUIAgent.js:205:40) at async GUIAgent.run (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/GUIAgent.js:203:59) at async start (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/cli/dist/cli/start.js:161:5) at async Command. (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/cli/dist/cli/commands.js:40:13) { status: 404, headers: { 'access-control-allow-credentials': 'true', 'access-control-allow-origin': '', connection: 'keep-alive', 'content-length': '0', date: 'Wed, 07 May 2025 10:02:21 GMT', vary: 'origin, access-control-request-method, access-control-request-headers, origin, access-control-request-method, access-control-request-headers', 'x-proxied-host': 'http://10.101.38.121', 'x-proxied-path': '/chat/completions', 'x-proxied-replica': '2u4aflr0-4huph', 'x-request-id': 'hfDwe6' }, request_id: 'hfDwe6', error: undefined, code: undefined, param: undefined, type: undefined } { code: -100001, error: 'GUIAgent Service Error', stack: 'Error: 404 status code (no body)' } { version: 'v1', systemPrompt: 'You are a GUI agent. You are given a task and your action history, with screenshots. You need to perform the next action to complete the task.\n' + '\n' + '## Output Format\n' + '\n' + 'Thought: ...\n' + 'Action: ...\n' + '\n' + '\n' + '## Action Space\n' + "click(start_box='[x1, y1, x2, y2]')\n" + "type(content='')\n" + "swipe(start_box='[x1, y1, x2, y2]', end_box='[x3, y3, x4, y4]')\n" + "scroll(start_box='[x1, y1, x2, y2]', direction='down or up or right or left') # You must spesify the start_box\n" + "hotkey(key='') # The available keys: enter,back,home,backspace,delete,menu,power,volume_up,volume_down,mute,lock\n" + 'wait() #Sleep for 2s and take a screenshot to check for any changes.\n' + 'press_home() # Press the home key\n' + 'finished()\n' + "call_user() # Submit the task and call the user when the task is unsolvable, or when you need the user's help.\n" + '\n' + '## Note\n' + '- Write a small plan and finally summarize your next action (with its target element) in one sentence in Thought part.\n' + '\n' + '## User Instruction\n', instruction: 'Help me launch tiktok', modelName: 'xxx', status: 'error', logTime: 1746612138327, conversations: [ { from: 'human', value: 'Help me launch tiktok', timing: [Object] }, { from: 'human', value: '', screenshotBase64: 'iVBORw0KG... 4149548 more characters, screenshotContext: [Object], timing: [Object] } ], error: { code: -100001, error: 'GUIAgent Service Error', stack: 'Error: 404 status code (no body)' } } [GUIAgent] finally: status error Failed to start NotFoundError: 404 status code (no body) at APIError.generate (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/openai/error.js:54:20) at OpenAI.makeStatusError (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/openai/core.js:299:33) at OpenAI.makeRequest (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/openai/core.js:343:30) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async UITarsModel.invokeModelProvider (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/Model.js:77:24) at async UITarsModel.invoke (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/Model.js:104:24) at async external_async_retry_default.retries._retry_model (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/GUIAgent.js:205:40) at async GUIAgent.run (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/sdk/dist/GUIAgent.js:203:59) at async start (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/cli/dist/cli/start.js:161:5) at async Command. (/Users/boraturan/.npm/_npx/c5a28f0bb5c49ce0/node_modules/@ui-tars/cli/dist/cli/commands.js:40:13) { status: 404, headers: { 'access-control-allow-credentials': 'true', 'access-control-allow-origin': '*', connection: 'keep-alive', 'content-length': '0', date: 'Wed, 07 May 2025 10:02:21 GMT', vary: 'origin, access-control-request-method, access-control-request-headers, origin, access-control-request-method, access-control-request-headers', 'x-proxied-host': 'http://10.101.38.121', 'x-proxied-path': '/chat/completions', 'x-proxied-replica': '2u4aflr0-4huph', 'x-request-id': 'hfDwe6' }, request_id: 'hfDwe6', error: undefined, code: undefined, param: undefined, type: undefined }

boraturant avatar May 07 '25 10:05 boraturant

Hi,it looks like the problem is still due to the base URL and the model name. We have tried to depoy the model on hugging face to enable the desktop app successfully. Please make sure the base url ends with '/v1/' and the model name is 'UI-TARS-1.5-7B'.

Image Thank you for inform us this problom, we wil update the quickstart doc soon!

Taoran-Lu avatar May 19 '25 06:05 Taoran-Lu