66RomanReigns

[BUG] <title>

1

### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this? - [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions ### 该问题是否在FAQ中有解答？ | Is there an...

使用Badam多卡训练中途弹出Invalidate trace cache @ step 2: expected module 1, but got module 332并停止训练

11

### Reminder - [X] I have read the README and searched the existing issues. ### System Info ][INFO|trainer.py:4117] 2024-11-29 00:18:59,105 >> ***** Running Evaluation ***** [INFO|trainer.py:4119] 2024-11-29 00:18:59,105 >> Num...

AssertionError: no sync context manager is incompatible with gradientpartitioning logic of ZeRo stage 3

30

I encountered an issue while using DeepSpeed with ZeRO Stage 3 optimization. I received the following error: no_sync is not compatible with ZeRO Stage 3. I’m not sure how to...