ScreenAgent

ScreenAgent copied to clipboard

模型加载

7

再请教一个问题，训练好的sat模型如何再两张GPU上加载并推理？ 我目前只有A100（40G）的版本，有时推理会报内u才能溢出。 请问如何设置多GPU推理？ 下面模型加载部分如何设置呢？谢谢 `# load model model, model_args = AutoModel.from_pretrained( args.from_pretrained, args=argparse.Namespace( deepspeed=None, local_rank=0, rank=0, world_size=1, model_parallel_size=1, mode='inference', skip_init=True, use_gpu_initialization=True if torch.cuda.is_available() else False, device='cuda', overwrite_args={'model_parallel_size': 2}, **vars(args) ))...

WeiminLee

GPU Memroy

2

Hello, I just wondering how manu GPU that we need to run this model? And is it support quantization method?

irfanfadhullah

您好，可以不用vnc连接控制电脑，直接对电脑进行操作吗。

2

Jamie166

I got a blank desktop, is anybody encountering this? I am running on Macbook with M3 chip. Is this an issue with the AMD64? Below are some logs from the...

chen-yifu

Project collaboration

1

I have been working on a computer automating project below. The repo contains my thoughts and model architecture skeletons, even some working prototypes. The link: https://github.com/james4ever0/agi_computer_control If you don't mind,...

James4Ever0

程序在这个位置卡住不动：[Automaton:Acting] Submit Actions

5

您好，给出的4个例子，程序在执行子任务时，都卡在Submit Actions，有以下两个问题请教： 1. 为什么卡在此处？此处功能是啥？做了啥操作？ 2. 如何加速此处？  

linxi1158

ZJUTSong

Could you please help me to explain the missions of VNC server?

PhamQuocHuy1101

Windows Run error

1

todo

276585877