OmniParser
OmniParser copied to clipboard
[Tech Question] Is it usable for autonomous data analysis?
Assuming the controlled VM is loaded with plenty local data, can I use OmniParser to drive VM-installed MATLAB/JupyterLab etc. to do automated data analysis?
It seems transcripting icons and texts from the screenshot, can it "see" plotted graph and pass that to the LLM reasoner somehow?
If this is not supported by date, is/will it on the roadmap?