[Suggestion] Integrate with Deepspeed MII

[ipdeft]

First off, awesome project, been using it for two months - hats off to all the contributors.

I wanted to share something, incase you may find it useful/worthwhile - if not feel free to discard this "issue".

Potential 1.9x speedup of SD workload - If I was a better programmer, I'd take a stab at this myself ;) https://github.com/microsoft/DeepSpeed-MII

Either way, keep up the awesome work

[Maxxxel]

This looks cool