musicfish1973 comments

Repositories
Issues
Comments

Results 3 comments of


                                            musicfish1973

[Help] 如何支持多显卡

> > CUDA_VISIBLE_DEVICES=0,1 > > 夹在web_demo.py么？系统环境变量

[Help] 如何支持多显卡

> CUDA_VISIBLE_DEVICES=0,1 设了CUDA_VISIBLE_DEVICES=0,1后，用nvidia-smi命令也只看到用了GPU 0呢？

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 432.00 MiB (GPU 2; 23.65 GiB total capacity; 20.88 GiB already allocated; 259.56 MiB free;

(OpenChatKit) root@aca2869c8358:~/OpenChatKit-main# python inference/bot.py Loading /root/OpenChatKit-main/inference/../huggingface_models/GPT-NeoXT-Chat-Base-20B to cuda:0... Traceback (most recent call last): File "/root/OpenChatKit-main/inference/bot.py", line 185, in main() File "/root/OpenChatKit-main/inference/bot.py", line 181, in main ).cmdloop() File "/root/anaconda3/envs/OpenChatKit/lib/python3.10/cmd.py", line 105,...