Zheng Xu

单机多卡加载模型时卡住

3

torch 1.13 cuda 11.7 推理代码能正常运行 训练开4卡4090，加载模型时卡住，cpu占用100%，显卡占用100% torchrun --nnodes=1 --nproc_per_node=4 --rdzv_id=1 --rdzv_backend=c10d --rdzv_endpoint=localhost:12345 finetune_cpm_bee.py --use-delta --model-config config/cpm-bee-10b.json --dataset datasets/eprstmt/binary/dev --eval_dataset datasets/eprstmt/binary/eval_dev --epoch 100 --batch-size 4 --train-iters 100 --save-name cpm_bee_finetune --max-length 2048...

https://rlcard.org/games.html#simple-dou-dizhu

Old: when there are duplicate cards in seen_cards, playing one will discard all the cards, which is inconsistent with the three landlord card in DouZero and PerfectDou projects. Fix: only...