mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

build the "cpp" dir for android and how to generate vicuna-v1-7b-q4f16_0-opencl.so file?

Open yuwenjun1988 opened this issue 1 year ago • 0 comments

./mlc_chat_cli --model vicuna-v1-7b Use MLC config: "/data/local/tmp/build_arm/dist/vicuna-v1-7b-q4f16_0/params/mlc-chat-config.json" Use model weights: "/data/local/tmp/build_arm/dist/vicuna-v1-7b-q4f16_0/params/ndarray-cache.json" Cannot find library "vicuna-v1-7b-q4f16_0-opencl.so" in "dist"/prebuilt/lib or other search paths

yuwenjun1988 avatar Jun 08 '23 12:06 yuwenjun1988