torchrec icon indicating copy to clipboard operation
torchrec copied to clipboard

ManagedCollisionEmbeddingBagCollectionSharder cannot support CPU

Open YuandongXu-hotstar opened this issue 6 months ago • 2 comments

Does ManagedCollisionEmbeddingBagCollectionSharder only support cuda? I want to use ManagedCollisionEmbeddingBagCollection in CPU only environment. But I cannot resolve the "RuntimeError: No available sharding type and compute kernel combination after applying user provided constraints for XXX" What should I do?

for shard types that each sharder supports in CPU device type: EmbeddingBagCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'table_column_wise'] FeatureProcessedEmbeddingBagCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'table_column_wise'] EmbeddingCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'row_wise'] FusedEmbeddingBagCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'table_column_wise'] QuantEmbeddingBagCollectionSharder: ['table_wise', 'row_wise', 'column_wise'] QuantEmbeddingCollectionSharder: ['table_wise', 'row_wise', 'column_wise'] ManagedCollisionEmbeddingBagCollectionSharder: [] ----------------------> this is empty list ManagedCollisionEmbeddingCollectionSharder: ['row_wise'] QuantManagedCollisionEmbeddingCollectionSharder: ['row_wise']

Can I use EmbeddingBagCollectionSharder when I use ManagedCollisionEmbeddingBagCollection for the embeddings? What would be the behavior?

YuandongXu-hotstar avatar May 08 '25 08:05 YuandongXu-hotstar