Zmeo comments

Repositories
Issues
Comments

Results 1 comments of


                                            Zmeo

[BUG] 多卡微调报错

在加大了数据量，save_step拉到40之后，同样出现了tmp-checkpoint-40不存在的报错 > File "/home/kas/.conda/envs/MiniCPMV/lib/python3.10/site-packages/transformers/trainer.py", line 2383, in _save_checkpoint > os.rename(staging_output_dir, output_dir) > FileNotFoundError: [Errno 2] No such file or directory: '/home/kas/lx/code/MiniCPM-V/finetune/output/3d-100/output_minicpmv2/tmp-checkpoint-40' -> '/home/kas/lx/code/MiniCPM-V/finetune/output/3d-100/output_minicpmv2/checkpoint-40'