Qi

stuck running >>bash training_scripts/single_gpu/run_1.3b.sh

1

I run it on Ubunu 20.04 with 2 3090 cards, it always get stuck, py-spy dump shows: Process 46930: /home/qi/anaconda3/envs/deepspeed/bin/python -u main.py --local_rank=0 --model_name_or_path facebook/opt-1.3b --gradient_accumulation_steps 2 --lora_dim 128 --zero_stage...