amd-mi200 CI test failure

[github-actions[bot]]

The Nightly CI for https://github.com/microsoft/DeepSpeed/actions/runs/9200021800 failed.

[loadams]

cc: @jithunnair-amd and @rraminen - new issue opened because we closed the previous one. Once we merge the ROCm update to 5.6 PR I believe there are still failing tests, some of which I think are around the fact that apex isn't properly installing the amp_c extensions.