torchrec
torchrec copied to clipboard
OSS TorchRec Internal MPZCH modules (#3017)
Summary:
Major changes
- Copy the following files from
fbto corresponding location in thetorchrecrepositoryfb/distributed/hash_mc_embedding.py → torchrec/distributed/hash_mc_embedding.pyfb/modules/hash_mc_evictions.py → torchrec/modules/hash_mc_evictions.pyfb/modules/hash_mc_metrics.py → torchrec/modules/hash_mc_metrics.pyfb/modules/hash_mc_modules.py → torchrec/modules/hash_mc_modules.pyfb/modules/tests/test_hash_mc_evictions.py → torchrec/modules/tests/test_hash_mc_evictions.pyfb/modules/tests/test_hash_mc_modules.py → torchrec/modules/tests/test_hash_mc_modules.py
- Create a
test_hash_zch_mc.pyfile intorchrec/distributed/testsfolder following thetest_quant_mc_embedding.pyintorchrec/fb/distributed/tests.- trimmed quantization and inference codes, and only kept the training part.
- rewire the related packages from
torchrec.fbtotorchrec
- Update
BUCKfiles in related folders - Update the affected repos to use
torchrecmodules instead of the modules intorchrec.fb - Update
/modules/hash_mc_metrics.py- Replace the tensorboard module with a local file logger in
hash_mc_metrics.pymodule
- Replace the tensorboard module with a local file logger in
- Update the license declaration headers for the four OSS files
ToDos after landing this Diff
- Clean the duplicated
hash_mc_modules.pyfile in thefbfolder for safe landing.
Differential Revision: D76476676
This pull request was exported from Phabricator. Differential Revision: D76476676
This pull request was exported from Phabricator. Differential Revision: D76476676
This pull request was exported from Phabricator. Differential Revision: D76476676
This pull request was exported from Phabricator. Differential Revision: D76476676
This pull request was exported from Phabricator. Differential Revision: D76476676
This pull request was exported from Phabricator. Differential Revision: D76476676
This pull request was exported from Phabricator. Differential Revision: D76476676
This pull request was exported from Phabricator. Differential Revision: D76476676
This pull request was exported from Phabricator. Differential Revision: D76476676
This pull request was exported from Phabricator. Differential Revision: D76476676
This pull request has been reverted by 3ef5b3797e00f7b0e2dda8028c02b26b5a0978b8.