OmniParser icon indicating copy to clipboard operation
OmniParser copied to clipboard

Add command line option to run omniparser gradio app.py without VM (--no_vm)

Open teddybear082 opened this issue 9 months ago • 5 comments

-add commandline option for gradio app.py, --no_vm, to run omniparser on user's local computer rather than requiring windows VM

-persist commandline option state for session across scripts by using environment variable

-add powershell script for easier install of models on windows

-modify gitignore to ignore virtual environment (venv) and bat files if any that may be added by the user , as well as temp directory for screenshot pictures

-add separate requirements.txt for gpu use

teddybear082 avatar Mar 01 '25 16:03 teddybear082

@microsoft-github-policy-service agree

@microsoft-github-policy-service agree

teddybear082 avatar Mar 01 '25 17:03 teddybear082

Hello, I am a Chinese user. I can't access the api provider here, such as grop, but I have the deepseek api. I don't know how to change the code so that I can use the deepseek api without using grop

YangYa666 avatar Mar 02 '25 09:03 YangYa666

Hello, I am a Chinese user. I can't access the api provider here, such as grop, but I have the deepseek api. I don't know how to change the code so that I can use the deepseek api without using grop

This is off topic for this pull request but if deepseek has an openai-compatible API with tools use, you might be able to get away with hacking in support by modifying this file: https://github.com/microsoft/OmniParser/blob/master/omnitool/gradio/agent/llm_utils/oaiclient.py in your own local install to hard code the base url as deep seek’s API URL instead of OpenAI’s, and hard code whatever model name deep seek requires you to use. Then in the user interface select openai as the provider (which is the default anyway) and put your deepseek API key in. It might work but there’s no guarantees. Proper built in support would require more steps.

teddybear082 avatar Mar 02 '25 10:03 teddybear082

does the local machine support Mac or only windows?

kaiseu avatar Mar 09 '25 12:03 kaiseu

does the local machine support Mac or only windows?

I don't have a mac to test so I have no idea, it works on windows. However, all I'm doing is redirecting pyautogui commands to run directly on the local machine rather than searching for a virtual machine and sending the commands to it. According to pyautogui it works with Mac so unless something else in this library requires windows seems like it should work although if you encounter errors on mac maybe see if you need to install an additional dependency based on the pyautogui documentation: https://pypi.org/project/PyAutoGUI/.

teddybear082 avatar Mar 09 '25 16:03 teddybear082