xavierdawn

In Step 1: Warmup training，multiple gpu's trainning

5

I want to train with multiple gpu's, besides setting the export header="torchrun --nproc_per_node 4 --nnodes 1 and export CUDA_VISIBLE_DEVICES=4,5,6,7，is there anything else I need to set up? Because right now...