torchrec
torchrec copied to clipboard
Create an example for MPZCH
Summary:
Major changes
- Create a
mpzchfolder under thetorchrec/github/examplesfolder - Implement a simple SparseArch module with a flag to switch between original and MPZCH managed collision modules
- Profile the running time and QPS for model training(GPU)/inference(CPU)
- Create a notebook tutorial for ZCH basics and the use of ZCH modules in TorchRec
ToDos for OSS
- When the internal torchrec MPZCH module is OSS
- Remove the
BUCKfile - Replace all the
from torchrec.fb.modulesinsparse_arch.pytofrom torchrec.modules
- Remove the
Potential improvement
- Add hash collision counter
- Show profiling results in the Readme file
- Add multi-batch profiling
Reviewed By: aporialiao
Differential Revision: D75570684