Iris Z

[PT-D][Checkpoint] Rename DCP storage layer init()

25

Rename DCP storage layer init() and update tests accordingly.

[PT-D]Track PT-D fixes for release blocker to upgrade to PT 3.11

9

**Overview** Python 3.11 was [released in Oct 2022](https://www.python.org/downloads/release/python-3110/). It is the first release to include work from the “Faster CPython” workgroup. They advertise speedups between 10 and 60% depending on...

[PT-D][Checkpoint] Turn on all default planner flags

7

Fixes #92823

[DTensor] allow numel 1 tensor operand to be implicitly replicate DTensor

1

Fixes #ISSUE_NUMBER cc @mrshenli @pritamdamania87 @zhaojuanmao @satgera @rohan-varma @gqchen @aazzolini @osalpekar @jiayisuse @H-Huang @kwen2501 @awgu @penguinwu @fegin @XilunWu @wanchaol @fduwjj @tianyu-l @wconstab @yf225 @chauhang @d4l3k

[DTensor] Turn on foreach implementation of optimizer for DTensor by default

10

Append DTensor to the optimizer `_foreach_supported_types` and turn on foreach implementation of optimizer for DTensor if not specified by the users. cc @mrshenli @pritamdamania87 @zhaojuanmao @satgera @rohan-varma @gqchen @aazzolini @osalpekar...

[DeviceMesh] Fix hash and eq not match

38

Fixes #121799 We fix DeviceMesh hash such that two mesh are considered equal if they have the same mesh and same parent_mesh. Examples can be found here: https://github.com/pytorch/pytorch/issues/121799 Also need...

[FSDP1] Update docstring to include device_mesh arg

1

Fixes #126548 cc @mrshenli @pritamdamania87 @zhaojuanmao @satgera @gqchen @aazzolini @osalpekar @jiayisuse @H-Huang @kwen2501 @awgu @penguinwu @fegin @XilunWu @wanchaol @fduwjj @tianyu-l @wconstab @yf225 @chauhang @d4l3k

[torchtitan][optim] Add fused as an option in train config

3

With these three PRs landed, we can now support the option fused=True in torchtitan for Adam and AdamW optimizer. https://github.com/pytorch/pytorch/pull/125369 https://github.com/pytorch/pytorch/pull/126423 https://github.com/pytorch/pytorch/pull/126750