521bibi

### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction export CUDA_VISIBLE_DEVICES=0,1,2 deepspeed --num_gpus 3 src/train_bash.py \ --deepspeed ds_z3_config.json \ --stage sft \ --do_train...