EnergonAI
EnergonAI copied to clipboard
Large-scale model inference.
When I tried to compile the energonai library, an error is reported: `D:\Anaconda3\lib\site-packages\torch\utils\cpp_extension.py:358: UserWarning: Error checking compiler version for cl: [WinError 2] 系统找不到指定的文件。 warnings.warn(f'Error checking compiler version for {compiler}: {error}')...
root@2d8fec1401d1:/workspace/EnergonAI# python examples/gpt/gpt_batch_server.py Traceback (most recent call last): File "/workspace/EnergonAI/examples/gpt/gpt_batch_server.py", line 7, in from energonai.engine import InferenceEngine ImportError: cannot import name 'InferenceEngine' from 'energonai.engine' (/opt/conda/lib/python3.9/site-packages/energonai/engine.py) When I modified inferenceEngine. Another...
When installing this with ```pip install .``` , the following error is encountered: ``` fatal error: cub/cub.cuh: No such file or directory #include ^~~~~~~~~~~~~ compilation terminated. ``` The complete log...