Li Xingjian

The `legacy` directory is deprecated now. Some code that uses dependencies from `legacy` is out-of-date. You can try to refer to the new implementations.

@awer-A You can try install colossalai from source. I suggest if you want to set up a distributed training environment with ColossalAI on your server, you can follow the instructions...

Hi, it seems like your bash script syntax problem ``` /bin/bash: -c: line 0: unexpected EOF while looking for matching `"' /bin/bash: -c: line 1: syntax error: unexpected end of...

@ver217

Hi @insujang, the reason why applying `LazyInitContext` does not load pretrained parameters into the model, is because under lazy init context, lazy tensors have not been materialized until they are...

Hi @insujang I mean the full script works for me, ```python import colossalai from colossalai.lazy import LazyInitContext from colossalai.booster import Booster from colossalai.booster.plugin import HybridParallelPlugin from transformers import GPT2LMHeadModel MODEL_PATH...

@ustiugov