ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[autoparallel] Add metainfo support for F.linear

Open Cypher30 opened this issue 3 years ago • 0 comments

What’s New?

In this PR, I done some work to support torch.nn.functional.linear in our metainfo generation, the memory estimation results are aligned with torch.nn.Linear (without bias). And though the biased linear is now separated by us into matmul and bias add, I still retain the part that generate metainfo for biased linear for future use.

Cypher30 avatar Nov 18 '22 10:11 Cypher30