ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard
verified publisher icon hpcaitech

[BUG]: run opt inference but failed with No module named 'energonai'

Open munger1985 opened this issue 1 year ago • 0 comments

Is there an existing issue for this bug?

  • [X] I have searched the existing issues

🐛 Describe the bug

[BUG]: run opt inference but failed with No module named 'energonai' python opt_fastapi.py opt-125m --tp 2 --checkpoint /home/ubuntu/ColossalAI/examples/tutorial/opt/inference/opt-125m

Environment

ubuntu 22, python 3.10, cuda 12.3 ,colossalai-0.4.0

munger1985 avatar Jul 13 '24 08:07 munger1985