Jiarui Fang（方佳瑞）
Jiarui Fang（方佳瑞）
did you install ninja? It is in requirements.txt
Could you please update the [colossalai_baseline.py](https://github.com/theblackcat102/copycat/blob/master/colossalai_baseline.py) using synthetic data (rand generated)? I can not download the dataset.
Sorry I can not run the code. I think mt5 use some apex kernels, which is not supported by CAI right now.
https://github.com/hpcaitech/ColossalAI/blob/main/examples/language/gpt/README.md Of course, ColossalAI is a general framework. You can refer the GPT example.
hi, as indicated by the logs, your input data type is wrong. Can you check if the text you feed in the tokenizer is the correct type (str or List[str])?
有考虑module的buffer么？静态方法buffer既不被计入model data也不被计入non model data?
https://github.com/hpcaitech/ColossalAI/pull/1897 https://github.com/hpcaitech/ColossalAI/pull/1937
@bestbzw I believe our dockerfile is a good reference. https://github.com/hpcaitech/ColossalAI/blob/main/docker/Dockerfile#L4
Does this PR still valid? Or the developer has gavin up?
Currently, a config file is not necessary. See this as the latest CAI GPT example https://github.com/hpcaitech/ColossalAI/blob/main/examples/language/gpt/README.md