ldtgodlike

### Is there an existing issue for this? - [X] I have searched the existing issues ### Current Behavior ptuning v2微调的时候突然loss异常增大，然后接着loss就为0了。是不是某种bug造成了梯度爆炸，把学习率从2e-2 一直调小到1e-3都不行 ### Expected Behavior  ### Steps To Reproduce...

deepspeed train flux1 dreambooth lora can not save model

16

### Describe the bug when I run the script train_dreambooth_lora_flux.py. It raise ValueError: unexpected save model: . something bug in save_model_hook? ![Uploading image.png…]() ### Reproduction accelerate launch train_dreambooth_lora_flux_custom.py \ --pretrained_model_name_or_path=$MODEL_NAME...