mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

[Bug] make[2]: *** [tokenizers/CMakeFiles/tokenizers_c.dir/build.make:71: tokenizers/release/libtokenizers_c.a] Error 1

Open felixslu opened this issue 1 year ago • 2 comments

🐛 Bug

To Reproduce

  1. python3 build.py --hf-path databricks/dolly-v2-3b --quantization q3f16_0 (It is OK!)
  2. Build the CLI : cd build cmake .. make

Expected behavior

[ 0%] Built target mlc_llm_objs [ 0%] Built target mlc_cli_objs [ 45%] Built target sentencepiece-static [ 54%] Built target tvm_libinfo_objs [100%] Built target tvm_runtime_objs [100%] Built target tvm_runtime [100%] Generating release/libtokenizers_c.a No such file or directory make[2]: *** [tokenizers/CMakeFiles/tokenizers_c.dir/build.make:71: tokenizers/release/libtokenizers_c.a] Error 1 make[1]: *** [CMakeFiles/Makefile2:553: tokenizers/CMakeFiles/tokenizers_c.dir/all] Error 2 make: *** [Makefile:156: all] Error 2

Environment

  • Platform (Intel):
  • Operating system ( Ubuntu):
  • Device ( PC+RTX 3090, ...)
  • How you installed MLC-LLM (source):
  • How you installed TVM-Unity (pip):
  • Python version (3.11):
  • GPU driver version (if applicable):
  • CUDA/cuDNN version (if applicable):
  • TVM Unity Hash Tag (python -c "import tvm; print('\n'.join(f'{k}: {v}' for k, v in tvm.support.libinfo().items()))", applicable if you compile models):
  • Any other relevant information:

Additional context

image

image

felixslu avatar Jun 06 '23 13:06 felixslu

Did you install rust and cargo?

junrushao avatar Jun 06 '23 13:06 junrushao

Did you install rust and cargo?

Yes,I have install rust and cargo , by commands below,and resolve this compile error! Thanks a lot!

`1、apt install cargo

2、mkdir -p build bash scripts/prep_deps.sh source "$HOME/.cargo/env" python3 cmake/gen_cmake_config.py cp config.cmake build cd build cmake .. make`

https://mlc.ai/mlc-llm/docs/install/index.html#cli-build-from-source https://github.com/mlc-ai/mlc-llm/blob/main/ios/README.md

felixslu avatar Jun 07 '23 01:06 felixslu

/prep_deps.sh I coun't find it, please tell me how to solve.

railgun-zyy avatar Jun 13 '23 06:06 railgun-zyy