binmakeswell

Hi @ver217 Could you please help guys with shardinit? Thanks.

LazyInit is a new good choice. For large models causing OOM in init, you can use "lazy init + from huggingface config", through gemini, then load checkpoint. ``` from colossalai.utils.model.experimental...

Hi @graciechen @wqw547243068 @cloudfool We have updated a lot. Please check the latest code and doc. https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat/examples This issue was closed due to inactivity. Thanks.

Hi @NKcqx @shendl1978 We have updated a lot. Please check the latest instructions https://github.com/hpcaitech/ColossalAI#Installation This issue was closed due to inactivity. Thanks.

Hi @programmin1 Yes, you can check the detailed requirements. https://github.com/hpcaitech/ColossalAI#Installation This issue was closed due to inactivity. Thanks.

Hi @laozhanghahaha Welcome to check our new LazyInit #2770 We have updated a lot.

Hi, @JThh The pre-commit CI fails. Could you polish your code with pre-commit? You can refer to https://github.com/hpcaitech/ColossalAI/blob/main/CONTRIBUTING.md#code-style

Thanks for your feedback. Sorry for this issue, we are a small team and have to focus on development currently. Maybe we will update the doc maybe next month. This...

> ``` > sort all imports (python)................................................Failed > - hook id: isort > - files were modified by this hook > > Fixing /fsx/home-yhna/test/ColossalAI/colossalai/zero/sharded_optim/sharded_optim_v2.py > > yapf formatter...........................................................Passed > clang...

@yhna940 Thank you very much for your contribution!