Samyak Jain comments

Repositories
Issues
Comments

Results 1 comments of


Samyak Jain

Idefics2 fine-tuning: Error when unscale_gradients called on FP16 gradients during training with transformers and accelerate

I'm facing the same issue with `torch_dtype=torch.float16` > I found a solution, remove `torch_dtype`, and it should work fine! If `torch_dtype=torch.float16` is removed, the model weights take double the memory...