torchrec icon indicating copy to clipboard operation
torchrec copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

prototype sharding by device group

Open gnahzg opened this issue 1 year ago • 1 comments

Summary: This is a prototype that support tables with same sharding type but place on different device group. e.g some table-wise sharded table placed on CPU, some table-wise sharded table on CUDA.

The main change is instead of group sharding infos by sharding_type, we group them by (sharding_type, device_group)

Differential Revision: D56147625

gnahzg avatar Apr 15 '24 17:04 gnahzg

This pull request was exported from Phabricator. Differential Revision: D56147625

facebook-github-bot avatar Apr 15 '24 17:04 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D56147625

facebook-github-bot avatar May 14 '24 21:05 facebook-github-bot

This pull request was exported from Phabricator. Differential Revision: D56147625

facebook-github-bot avatar May 15 '24 13:05 facebook-github-bot