ColossalAI
ColossalAI copied to clipboard
[tensor] added mlp implementation for the new sharding spec
The previous PR #1405 implemented the sharding spec. This PR implements the linear distributed computation using the new sharding spec API.