Agent-S icon indicating copy to clipboard operation
Agent-S copied to clipboard

New Provider for Cua

Open f-trycua opened this issue 9 months ago • 4 comments

Currently we support different LLM Providers to execute computer-use workflows locally on macOS Apple Silicon: https://github.com/trycua/cua

It'd be interesting to have a new Agent Loop for Agent-S. So far we support 3 loops:

  • OpenAI: based on OpenAI computer-use-preview
  • Anthropic: based on Claude Sonnet 3.5/7 with computer-use beta flags
  • Omni: based on OmniParser and any VLMs

Happy to support you guys with this work if interested! Issue in our repo: https://github.com/trycua/cua/issues/83

f-trycua avatar Apr 02 '25 13:04 f-trycua

Hi @f-trycua your work is amazing. let's do it!

simularlyon avatar Apr 02 '25 21:04 simularlyon

Thanks @simularlyon - would you like to join our Discord? I can set up a bridge channel there. Let me know your user once you join :)

https://discord.com/invite/mVnXXpdE85

f-trycua avatar Apr 03 '25 19:04 f-trycua

@f-trycua I'm also interested to do this work

Amrithesh-Kakkoth avatar Jul 17 '25 09:07 Amrithesh-Kakkoth

Any progress on this?

JohannesTK avatar Oct 14 '25 08:10 JohannesTK