ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[autoparallel] add binary elementwise metainfo for auto parallel

Open Cypher30 opened this issue 3 years ago • 0 comments

What's New?

In this PR, I add binary elementwise metainfo for auto parallel. I also fix some annotations.

NOTE: Currently this metainfo is only a rough estimation for binary elementwise operations, in some cases, memory estimation could not match with the real one. Moreover, the memory footprint of different operations could be different, I will dive into those problems later.

Cypher30 avatar Dec 01 '22 07:12 Cypher30