torchrec
torchrec copied to clipboard
ManagedCollisionEmbeddingBagCollectionSharder cannot support CPU
Does ManagedCollisionEmbeddingBagCollectionSharder only support cuda? I want to use ManagedCollisionEmbeddingBagCollection in CPU only environment. But I cannot resolve the "RuntimeError: No available sharding type and compute kernel combination after applying user provided constraints for XXX" What should I do?
for shard types that each sharder supports in CPU device type: EmbeddingBagCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'table_column_wise'] FeatureProcessedEmbeddingBagCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'table_column_wise'] EmbeddingCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'row_wise'] FusedEmbeddingBagCollectionSharder: ['data_parallel', 'table_wise', 'column_wise', 'table_column_wise'] QuantEmbeddingBagCollectionSharder: ['table_wise', 'row_wise', 'column_wise'] QuantEmbeddingCollectionSharder: ['table_wise', 'row_wise', 'column_wise'] ManagedCollisionEmbeddingBagCollectionSharder: [] ----------------------> this is empty list ManagedCollisionEmbeddingCollectionSharder: ['row_wise'] QuantManagedCollisionEmbeddingCollectionSharder: ['row_wise']
Can I use EmbeddingBagCollectionSharder when I use ManagedCollisionEmbeddingBagCollection for the embeddings? What would be the behavior?