ColossalAI
ColossalAI copied to clipboard
[autoparallel] Add metainfo support for F.linear
What’s New?
In this PR, I done some work to support torch.nn.functional.linear in our metainfo generation, the memory estimation results are aligned with torch.nn.Linear (without bias). And though the biased linear is now separated by us into matmul and bias add, I still retain the part that generate metainfo for biased linear for future use.