what is coati and how to install

[Modas-Li]

🐛 Describe the bug

Traceback (most recent call last): File "train_sft.py", line 7, in from coati.dataset import DataCollatorForSupervisedDataset, SFTDataset, SupervisedDataset ModuleNotFoundError: No module named 'coati' Traceback (most recent call last): File "train_sft.py", line 7, in from coati.dataset import DataCollatorForSupervisedDataset, SFTDataset, SupervisedDataset ModuleNotFoundError: No module named 'coati' Traceback (most recent call last): File "train_sft.py", line 7, in from coati.dataset import DataCollatorForSupervisedDataset, SFTDataset, SupervisedDataset ModuleNotFoundError: No module named 'coati' Traceback (most recent call last): File "train_sft.py", line 7, in from coati.dataset import DataCollatorForSupervisedDataset, SFTDataset, SupervisedDataset ModuleNotFoundError: No module named 'coati'

Environment

No response

[TongLi3701]

Hi Modas,

You will need to install the package inside folder https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat using pip install .

Then you will have module coati.

I will close this issue, if you have more questions, please reopen.

Thanks!

[Modas-Li]

Building wheels for collected packages: coati Building wheel for coati (setup.py) ... done Created wheel for coati: filename=coati-1.0.0-py3-none-any.whl size=63582 sha256=56804daa3dd2d332 f65cc00fed52545329f89de893f2b2370c5fdca85290c8ba Stored in directory: /tmp/pip-ephem-wheel-cache-ze69xz9j/wheels/e8/71/7c/45575a5c76c31c334b963c6a 660cb1b4f1881c79caeb57a45f Successfully built coati

And still cannot find coati: Traceback (most recent call last): Traceback (most recent call last): File "examples/train_sft.py", line 7, in File "examples/train_sft.py", line 7, in from coati.dataset import DataCollatorForSupervisedDataset, SFTDataset, SupervisedDatasetfr om coati.dataset import DataCollatorForSupervisedDataset, SFTDataset, SupervisedDataset

ModuleNotFoundErrorModuleNotFoundError: : No module named 'coati'No module named 'coati'

Traceback (most recent call last): File "examples/train_sft.py", line 7, in from coati.dataset import DataCollatorForSupervisedDataset, SFTDataset, SupervisedDataset ModuleNotFoundError: No module named 'coati' Traceback (most recent call last): File "examples/train_sft.py", line 7, in from coati.dataset import DataCollatorForSupervisedDataset, SFTDataset, SupervisedDataset ModuleNotFoundError: No module named 'coati' ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 11448) of binary: /data/anaconda3/bin/python

[TongLi3701]

Could you use pip list to check if your current env has coati?

[Modas-Li]

current env did not have coati, could you please advise me more,thx

Attempting uninstall: pyyaml Found existing installation: PyYAML 3.13 ERROR: Cannot uninstall 'PyYAML'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

[TongLi3701]

If you install successfully, you should be able to see coati installed in your environment. Please make sure you are in the right environment.

I suggest creating a new environment and installing all packages again.

Thanks.

[elven2016]

I also have this problem ,how do you solved? pip show it have already installed, but the train script appears this error ModuleNotFoundError: No module named 'coati'

[binmakeswell]

I also have this problem ,how do you solved? pip show it have already installed, but the train script appears this error ModuleNotFoundError: No module named 'coati'

Hi @elven2016 This is strange. Did you follow the installation instructions? How can we reproduce your mistake? https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat#install-the-environment

[Modas-Li]

Thank you for your email !您好，你的邮件我已收到，我会尽快给你回复。