awesome-deeplearning-resources Add Colossal-AI

Add Colossal-AI

Open binmakeswell opened this issue 2 years ago • 3 comments

Colossal-AI is a unified deep learning system for the big model era, which integrates many efficient techniques like multi-dimensional tensor parallelism, sequence parallelism, heterogeneous memory management, etc.

By using Colossal-AI, we could help users to efficiently and quickly deploy large AI model training and inference, reducing large AI model budgets and scaling down the labor cost of learning and deployment.

Thank you for your review and look forward to your reply.