Ke Wen

@pytorchbot merge

Does the term `Collectives` here refer to "collectives for control plane (torchrun/elastic)"? If so, can file name and class name like `Collectives.hpp` be renamed to more clearly differentiate from the...

In addition, it seems torch/csrc/distributed/c10d has many files now. Does it make sense for store to have its own directory? I am just not sure whether the new directory should...

@pytorchbot merge

@pytorchbot merge