Yoach Lacombe
Yoach Lacombe
Hey @chercheurkg, thanks for opening the issue ! Would be great to have a script to reproduce the issue, better yet if it's on a toy dataset! Also, could you...
Hey @chercheurkg, thanks for the additional details! Have you checked the shape of the 2D array? Having a reproducing script would be of tremendous help tbh!
The issue has been there for a while now, e.g it is mentioned in #11452, and a reason is given here: https://github.com/huggingface/transformers/issues/11452#issuecomment-851603295 It seems to be inherent to torch DDP,...
Hey @ArthurZucker ! I'm facing the same issue! Seems like it's coming from using `DynamicCache` and `autocast`, somewhere along the way the past key values stored in the `Cache` get...
Hey @arjunsinghrathore and @LiuZH-19, I'll likely release some fine-tuning code next week or the week after! May I ask what type of data do you have, out of curiosity ?...
Hey @amyeroberts, gentle ping to ask for a review! Many thanks for your help!
Many thanks for the review @amyeroberts, I've changed the code according to your comments! The only left to address is the loss computation being breaking changes. let me know what...
> @ylacombe I ran the slow tests in test_modeling_whisper. I get some failing tests, but the same ones fail on main as well, with the same output: As long as...
Hey @kirollosHossam, I not sure to follow what's your request here? Could you detail it a bit? Many thanks!
Hey @kyle-v6x, seems lile #30325 should have fixed this, could you verify that it does fix your issue ? Thanks for your help!