torchrec
torchrec copied to clipboard
pytorch
Pytorch domain library for recommendation systems
Publicly linking our project proposal for API decomposition, see https://docs.google.com/document/d/1T8oZ8zKbgHuy7q0rkpiyJC5fRUiRugR7oWk799qgFjk/edit# Feel free to comment directly in the doc. cc @YLGH @divchenko @zhuzilin
until we have 8 gpus, GPU unit tests are mostly skipped - Use smoke test from above to get some GPU signal. # conda run -n build_binary \ # python...
This is to accompany an edge case with EBCs that are based off of FBGEMM kernels including QuantEBC FusedEBC split_embedding_weights doesn't return parameters that are consistent in hashing (e.g. set(parameters())...
Summary: ATT currently calling split_embedding_weights repeatedly over FBGEMM kernels provide tensor views that are identical, but have different ids (hash values). As a result, it makes comparing tensors from state_dict...
ATT
See README # Running torchrec using NVTabular DataLoader First run nvtabular preprocessing to first convert the criteo TSV files to parquet, and perform offline preprocessing. For example ``` cd torchrec/torchrce/datasets/scripts/nvt/...
Summary: title Differential Revision: D37164841
