Iris Z

icon location @PyTorch Distributed.

Results 34 comments of Iris Z

[DTensor] allow numel 1 tensor operand to be implicitly replicate DTensor

@pytorchmergebot rebase

[DTensor] allow numel 1 tensor operand to be implicitly replicate DTensor

@pytorchmergebot merge

[DCP] Adds strict option to DefaultPlanner

Hmm. We do have a flag for distributed state dict checking this. Is this for when folks don't use dsd?

Converting to checkpoint.pd is not working

As @chrisociepa mentioned, the fix(https://github.com/pytorch/pytorch/pull/1234070) is landed in main. Therefore, closing the issue.

[DeviceMesh] Fix hash and eq not match

@pytorchmergebot rebase

[DeviceMesh] Fix hash and eq not match

@pytorchmergebot rebase

[DeviceMesh] Fix hash and eq not match

@pytorchmergebot rebase

[DeviceMesh] Fix hash and eq not match

@pytorchmergebot rebase

[DeviceMesh] Fix hash and eq not match

@pytorchmergebot rebase

[DTensor] Turn on foreach implementation of optimizer for DTensor by default

@pytorchmergebot rebase