PiPPy icon indicating copy to clipboard operation
PiPPy copied to clipboard

[spmd] torch.cat (aten.cat.default) not implemented for Distributed Tensor (tracking)

Open lessw2020 opened this issue 3 years ago • 0 comments

Implement a graph using torch.cat. convert it via SPMD

Receive: raise NotImplementedError( NotImplementedError: Operator aten.cat.default does not have a DistributedTensor rule registered.)

code location: File "/home/ubuntu/graph/spmd/api.py", line 110, in _get_dtensor_dispatch_graph (target_schema, redistribute, output_sharding,) = propagate_input_sharding( File "/home/ubuntu/graph/spmd/tensor/dispatch.py", line 167, in propagate_input_sharding raise NotImplementedError( NotImplementedError: Operator aten.cat.default does not have a DistributedTensor rule registered.

This is not blocking, just for tracking. Can create buffer and do what cat does for now.

lessw2020 avatar Oct 31 '22 21:10 lessw2020