ScreenAgent icon indicating copy to clipboard operation
ScreenAgent copied to clipboard

ScreenAgent: A Computer Control Agent Driven by Visual Language Large Model

Results 19 ScreenAgent issues
Sort by recently updated
recently updated
newest added

### 問題描述 當我嘗試在 Ubuntu 22.04.4 LTS 系統上運行ScreenAgent模型應用程式時,我使用了 NVIDIA RTX 3060, 3070ti, 和 3080 GPU。然而,我遇到了一個問題,導致了 `500 Internal Server Error`。錯誤日誌顯示問題出在使用 `xformers` 庫的 `memory_efficient_attention` 操作時。這個錯誤表明沒有可用的操作支持我的設定,具體問題包括: 1. **裝置不支持**:模型嘗試在 CPU 上運行,但需要 CUDA 環境。 2. **數據類型不支持**:使用了...

RANK=0 WORLD_SIZE=1 LOCAL_RANK=0 python cogagent_model_worker.py --host 0.0.0.0 --port 40000 --from_pretrained "saved_models/ScreenAgent-2312" --bf16 --max_length 2048 [2024-04-10 13:38:43,071] [INFO] [real_accelerator.py:191:get_accelerator] Setting ds_accelerator to cuda (auto detect) Please 'pip install apex' [2024-04-10 13:38:45,030]...

After git clone & setting up conda enviroment , python=3.8, execute : python run_controller.py -c config.yml got below issue: Exception in thread Thread-1: Traceback (most recent call last): File "d:\Users\FELIX\anaconda3\envs\ScreenAgent38\lib\threading.py",...

Is there any plan to release the ScreenAgent weights' huggingface version? I found that the sat is hard to use, lack of ecosystem and only support few quantization method.

性能如何呀? 需要具备什么硬件环境?

Hi, thanks for the interesting work and the awesome open-sourced codebase. I'd like to know what version of sat lib you used for ScreenAgent training. In the latest version(0.4.11), the...

整体报错如下,从huggingface那里下载的zip文件解压后得到的 model_config.json中对于"model_class":定义的是"FineTuneTrainCogAgentModel",但是我在print出member的时候发现并没有这个模型类型。 请问如何解决? [2024-03-17 07:41:22,582] [INFO] [real_accelerator.py:191:get_accelerator] Setting ds_accelerator to cuda (auto detect) 2024-03-17 07:41:24 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40000, max_length=2048, top_p=0.4, top_k=1, temperature=0.8, chinese=False, version='chat', quant=None,...

您好,模型训练需要跑多久,大概有多少参数量

你好,训练数据中,action的 坐标 是如何标注的 是大模型可以自动识别出来的吗