ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[BUG]: No module named 'colossalai.kernel.extensions'

Open MountainGG opened this issue 11 months ago • 3 comments

🐛 Describe the bug

I encountered this problem while running llama pre-training scripts in the application folder, using colossalai0.3.6 installed from source. 'cd ./ColossalAI-0.3.6; BUILD_EXT=1 python -m pip install -e .' .

1710387027565 1710387048821 1710386660604

Environment

colossalai0.3.6 torch2.1.2+cu118 python3.10 gcc10

MountainGG avatar Mar 14 '24 03:03 MountainGG

1710397315052

MountainGG avatar Mar 14 '24 06:03 MountainGG

Same problem I met. I use Open-Sora to train, stuck on this step. I notice there exsist a file called 'extensions' in folder ''colossalai/kerner', maybe that's a way to located extensions.py

polo-0831 avatar Mar 15 '24 03:03 polo-0831

Same problem I met. I use Open-Sora to train, stuck on this step. I notice there exsist a file called 'extensions' in folder ''colossalai/kerner', maybe that's a way to located extensions.py

This file seems to be a path connected to the outermost “extensions” folder. But pip or python does not seem to recognize it. If you use pip to uninstall colossalai, you may see that it is installed at the same level as colossalai.

MountainGG avatar Mar 18 '24 02:03 MountainGG

Same problem I met. I use Open-Sora to train, stuck on this step. I notice there exsist a file called 'extensions' in folder ''colossalai/kerner', maybe that's a way to located extensions.py

This file seems to be a path connected to the outermost “extensions” folder. But pip or python does not seem to recognize it. If you use pip to uninstall colossalai, you may see that it is installed at the same level as colossalai.

This (https://github.com/hpcaitech/ColossalAI/blob/main/colossalai/kernel/extensions) is a soft link to the parent extension folder. If you pull the main branch you shouldn't encounter this error. Alternatively, you can try `ln -s ../../extensions .' inside the colossalai.kernel folder. Feel free to reopen if not working.

Edenzzzz avatar Apr 18 '24 07:04 Edenzzzz