binmakeswell

Hi @SilenceGTX @zhangsanfeng86 We have updated a lot. Could you please the latest code? https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat/examples This issue was closed due to inactivity. Thanks.

> Warning: > > * `chatgpt.nn` has been modified as `chatgpt.models` > * The overall arch diagram is ... > >  > > If this error (No module named...

We have updated a lot. Please check the latest instructions https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat#install This issue was closed due to inactivity. Thanks.

Glad to hear it was resolved. Thanks.

Glad to hear it was resolved. Thanks.

> > upgrade gcc version from 4.8.5 to 9.5.0 fix this issue, but met another issue " AttributeError : module 'math' has not attribute prod " > > Great. The...

Hi @LhaoH @Thomas2419 Diffusion convergence is a challenging task, and Colossal-AI provides a more effective development tool. This issue does not seem to be a bug caused by Colossal-AI. For...

Hi @CreamyLong Please check the env reqiurement. https://github.com/hpcaitech/ColossalAI#installation This issue was closed due to inactivity. Thanks.

Hi @hijkzzz you can refer to https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat#faq for ChatGPT example. For more general cases, a #[new checkponint system](https://github.com/hpcaitech/ColossalAI/discussions/3339) will come soon. Thanks.

Hi @ScottishFold007 and @Sahajtomar Please check the note at the beginning https://github.com/hpcaitech/ColossalAI/tree/main/examples/tutorial#colossal-ai-tutorial-hands-on For large optimizer, you can refer to the verified version of [LAMB ](https://github.com/NUS-HPC-AI-Lab/pytorch-lamb)and [LARS](https://github.com/NUS-HPC-AI-Lab/LARS-ImageNet-PyTorch). For usage of Colossal-AI,...