OmniParser
OmniParser copied to clipboard
microsoft
A simple screen parsing tool towards pure vision based GUI agent
## **🚀 Issue Summary** When running `Florence-2` on Mac (M1/M2/M3) using `transformers`, the library **forces a `flash_attn` dependency**, which is unsupported on MPS. This leads to a `ImportError: flash_attn is...
在pip install -r requirements.txt中报错 Collecting pytweening>=1.0.4 (from pyautogui==0.9.54->-r requirements.txt (line 23)) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/79/0c/c16bc93ac2755bac0066a8ecbd2a2931a1735a6fffd99a2b9681c7e83e90/pytweening-1.2.0.tar.gz (171 kB) ERROR: Error [WinError 225] 无法成功完成操作，因为文件包含病毒或潜在的垃圾软件。 while executing command python setup.py egg_info Preparing metadata (setup.py)...
It is hoped that RDP protocol support can be provided to control the host, which can be more universal and simple. Thanks!
 I do not have access to docker desktop so using docker binaries. OS is windows server 2022. Initially i was having issues with docker compose command not recognizing shorthand...
File "D:\daima\OmniParser\.venv\Lib\site-packages\transformers\models\auto\auto_factory.py", line 526, in from_pretrained config, kwargs = AutoConfig.from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\daima\OmniParser\.venv\Lib\site-packages\transformers\models\auto\configuration_auto.py", line 1112, in from_pretrained raise ValueError( ValueError: Unrecognized model in weights/icon_caption_florence. Should have a `model_type` key in...
/.paddleocr/whl\det\en\en_PP-OCRv3_det_infer/inference.pdmodel, please confirm whether the file is normal.
env
all needs:activate omni models->weights python gradio_demo.py cd OmniParser/omnitool/omniparserserver python -m omniparserserver Windows 11 Enterprise Evaluation (90-day trial, English, United States) ISO rename->custom.iso custom.iso复制OmniParser/omnitool/omnibox/vm/win11iso cd OmniParser/omnitool/omnibox/scripts docker->>> ./manage_vm.sh create or .\manage_vm.ps1...
Getting this error when trying to run python -m omniparserserver What do i do?
2025-03-07 19:04:45 omni-windows | ❯ Starting OmniParser Windows for Docker v0.00... 2025-03-07 19:04:45 omni-windows | ❯ For support visit https://github.com/microsoft/OmniParser 2025-03-07 19:04:45 omni-windows | ❯ CPU: Intel Core TM i9...
