ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

Published 20 hours ago • verified publisher icon hpcaitech

[autoparallel] remove redundancy comm node

Open YuliangLiu0306 opened this issue 2 years ago • 0 comments

This PR mainly does two things:

  1. remove redundancy comm node: if the sharding spec of node output is same as the user node required sharding spec, we will not insert any node between this pair of nodes.
  2. The resharding costs just count the element numbers, size_per_elem_bytes is added in this PR.

YuliangLiu0306 avatar Nov 11 '22 05:11 YuliangLiu0306