DavidVillaHMD comments

Repositories
Issues
Comments

Results 3 comments of


                                            DavidVillaHMD

modules_to_save: "ValueError: Attempting to unscale FP16 gradients"

I am having the same problem here and not solved yet even I installed peft by the up-to-date repo. Just like the author of this issue, I'm trying to finetune...

modules_to_save: "ValueError: Attempting to unscale FP16 gradients"

New idea: Now the training finally works. Setting fp16=False would make the training be super slow and not mem-friendly. To avoid "ValueError: Attempting to unscale FP16 gradients", just make sure...

modules_to_save: "ValueError: Attempting to unscale FP16 gradients"

> > New idea: Now the training finally works. Setting fp16=False would make the training be super slow and not mem-friendly. > > To avoid "ValueError: Attempting to unscale FP16...