Vishwa Karia

[DRAFT: Do not merge] feature: enable SMDDP for Pytorch DDP distribution

16

*Issue #, if available:* *Description of changes:* *Testing done:* ## Merge Checklist _Put an `x` in the boxes that apply. You can also fill these out after creating the PR....

**Describe the feature you'd like** The Sagemaker training toolkit and Python SDK use string literals for attribute values in many places. For instance, SMDDP is supported on P3, P3dn and...

#### Use-case I have a client and server, each running on a different thread on the same GPU rank. I need to send data from client thread to server thread...