Cornucopia-LLaMA-Fin-Chinese icon indicating copy to clipboard operation
Cornucopia-LLaMA-Fin-Chinese copied to clipboard

Published 20 hours ago • verified publisher icon jerry1993-tech

多gpu怎么运行啊

Open longYGLlong opened this issue 2 years ago • 1 comments

image 我服务器8个gpu都是24G的运行报这个错误

longYGLlong avatar Jul 13 '23 07:07 longYGLlong

torchrun --nproc_per_node=8 ... 或 CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 torchrun --nproc_per_node=8 ...

jerry1993-tech avatar Aug 02 '23 08:08 jerry1993-tech