torchrec
torchrec copied to clipboard
Pytorch domain library for recommendation systems
Summary: keep it consistent with https://fburl.com/code/n6v2jb8f . We need to set these variables as empty to re-create_input_dist Differential Revision: D53167840
Summary: when extra features(keys) are passed to unsharded FeatureProcessedEmbeddingBagCollection, it needs to add dummy 1.0 weights to those excessive features to keep the kjt.weights.numel() same as kjt.values.numel() Reviewed By: YLGH...
Summary: We tried this idea before with default GreedyPartitioner, but we didn't land it, because: 1. we don't see significantly QPS improvment 2. Concern that if we don't place the...
I try to test the demo scripts with the following command. ```torchx run -s local_cwd dist.ddp -j 1x1 --script test_installation.py``` I try to print the gradients of embedding_bag_collection. I can...
Summary: LRU eviction policy with user-variable decay exponent (e.g. decay_exponent=1 is LRU with linear distance). Reviewed By: dstaay-fb Differential Revision: D52100910
Summary: Updated version of D50162035 that uses the new CacheStatistics interface, and updated for more sharding types. Jobs with large prefetch streams can be slowed down by large prefetch_compute blocking...