Jinghan Li

# What does this PR do? Fixes # (issue) ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks...

# What does this PR do? Fixes # (issue) ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks...

decouple backward and step in accelerator/deepspeed

1

# What does this PR do? Addressing this issue: https://github.com/huggingface/accelerate/issues/2951 This PR enables user to debug model gradient after backward+gradient_clipping and before optimizer.step(). To achieve this functionality, we move the...