No module named 'colossalai._C.cpu_adam_x86'

[MountainGG]

Discussed in https://github.com/hpcaitech/ColossalAI/discussions/5381

^{Originally posted by mackmake February 13, 2024} Hi and thanks for your efficient library. I wanted to pretrain so I installed packages with CUDA_EXT=1. Then I run the pretrain code with colossalai run and faced this error: No module named 'colossalai._C.cpu_adam_x86'

why it happens and how to fix it?

I had the same problem with py3.9, cuda117, torch1.13.1 and colossalai0.3.5, when running Colossal-LLaMA-2.

[ersanliqiao]

same error

[flybird11111]

Hi, please install the colossalai with BUILD_EXT=1. The latest version update includes the option BUILD_EXT=1. https://colossalai.org/docs/get_started/installation.

[ersanliqiao]

already add BUILD_EXT=1