OmniParser icon indicating copy to clipboard operation
OmniParser copied to clipboard

[Tech Question] Is it usable for autonomous data analysis?

Open complyue opened this issue 4 days ago • 0 comments

Assuming the controlled VM is loaded with plenty local data, can I use OmniParser to drive VM-installed MATLAB/JupyterLab etc. to do automated data analysis?

It seems transcripting icons and texts from the screenshot, can it "see" plotted graph and pass that to the LLM reasoner somehow?

If this is not supported by date, is/will it on the roadmap?

complyue avatar Feb 18 '25 15:02 complyue