mlc-llm
mlc-llm copied to clipboard
[Bug] make[2]: *** [tokenizers/CMakeFiles/tokenizers_c.dir/build.make:71: tokenizers/release/libtokenizers_c.a] Error 1
🐛 Bug
To Reproduce
- python3 build.py --hf-path databricks/dolly-v2-3b --quantization q3f16_0 (It is OK!)
- Build the CLI : cd build cmake .. make
Expected behavior
[ 0%] Built target mlc_llm_objs [ 0%] Built target mlc_cli_objs [ 45%] Built target sentencepiece-static [ 54%] Built target tvm_libinfo_objs [100%] Built target tvm_runtime_objs [100%] Built target tvm_runtime [100%] Generating release/libtokenizers_c.a No such file or directory make[2]: *** [tokenizers/CMakeFiles/tokenizers_c.dir/build.make:71: tokenizers/release/libtokenizers_c.a] Error 1 make[1]: *** [CMakeFiles/Makefile2:553: tokenizers/CMakeFiles/tokenizers_c.dir/all] Error 2 make: *** [Makefile:156: all] Error 2
Environment
- Platform (Intel):
- Operating system ( Ubuntu):
- Device ( PC+RTX 3090, ...)
- How you installed MLC-LLM (source):
- How you installed TVM-Unity (
pip
): - Python version (3.11):
- GPU driver version (if applicable):
- CUDA/cuDNN version (if applicable):
- TVM Unity Hash Tag (
python -c "import tvm; print('\n'.join(f'{k}: {v}' for k, v in tvm.support.libinfo().items()))"
, applicable if you compile models): - Any other relevant information:
Additional context
Did you install rust and cargo?
Did you install rust and cargo?
Yes,I have install rust and cargo , by commands below,and resolve this compile error! Thanks a lot!
`1、apt install cargo
2、mkdir -p build bash scripts/prep_deps.sh source "$HOME/.cargo/env" python3 cmake/gen_cmake_config.py cp config.cmake build cd build cmake .. make`
https://mlc.ai/mlc-llm/docs/install/index.html#cli-build-from-source https://github.com/mlc-ai/mlc-llm/blob/main/ios/README.md
/prep_deps.sh I coun't find it, please tell me how to solve.