mlc-llm
mlc-llm copied to clipboard
build the "cpp" dir for android and how to generate vicuna-v1-7b-q4f16_0-opencl.so file?
./mlc_chat_cli --model vicuna-v1-7b Use MLC config: "/data/local/tmp/build_arm/dist/vicuna-v1-7b-q4f16_0/params/mlc-chat-config.json" Use model weights: "/data/local/tmp/build_arm/dist/vicuna-v1-7b-q4f16_0/params/ndarray-cache.json" Cannot find library "vicuna-v1-7b-q4f16_0-opencl.so" in "dist"/prebuilt/lib or other search paths