gloo
gloo copied to clipboard
Gloo does not support empty inputs on reduce/allreduce/allgather
Reduce and Allreduce ops apply sanity check to enforce non-empty inputs [here]. Allgather returns error code 8 on empty inputs. Does it make sense to support empty inputs in these ops?