HDRBgg

麻烦博主了 [email protected]

AttributeError: 'NoneType' object has no attribute 'deepspeed_config'

7

Traceback (most recent call last): File "finetune_moss.py", line 303, in train(args) File "finetune_moss.py", line 175, in train accelerator.state.deepspeed_plugin.deepspeed_config['train_micro_batch_size_per_gpu'] = args.train_bsz_per_gpu AttributeError: 'NoneType' object has no attribute 'deepspeed_config'

单机单卡A100没必要部署分布式训练吧

2

finetune_moss.py 代码不使用分布式训练可以吗，改成单机gpu训练