ROCm support

[88Ocelot]

Initial support for ROCm

[olegklimov]

Oh I see, you wrote a Dockerfile!

We have no way to test it, because we have no AMD gpus, but maybe we can set up the building process and someone can test.

pip install deepspeed

@88Ocelot does this mean it will install deepspeed at a first launch, and there's no way to install it in Dockerfile currently?

That's a super nice contribution @88Ocelot !