张宇

Same error comes together with `TypeError: Accelerator.__init__() got an unexpected keyword argument 'use_seedable_sampler'`, update accelarator solves it: `pip install accelerate==0.27.2`

> Is the problem solved now? I come across the same problem with zero 3 on mix-modality training. The training always hangs at the make_experience stage, and the progress is...

The target_modules pattern ```"^(?!.*visual).*(?:o_proj|k_proj|gate_proj|up_proj|down_proj|q_proj|v_proj).*"``` caused this error. PEFT match it to lora layers in the model, tries to add lora for `Identity()` layer. The ```patch_target_modules ``` function should be fixed...

The line ```src\llamafactory\train\trainer_utils.py", line 146, in create_reward_model model.pretrained_model.load_adapter(finetuning_args.reward_model, "reward") ``` seems not loading pretrained rm as intended, since load_adapter degraded to add_adapter, which does not load any state_dict. Repeat the...