huanyingjun

Dear I try to build model for android according to the guide. when run "" `python3 build.py --model vicuna-v1-7b --quantization q4f16_0 --target android --max-seq-len 768` I get below error: ```...

How to build the "cpp" dir for android ?

1

Dear How to build the "cpp" dir as a stand alone executable bin for Android ? Thanks

8bit量化完后做推理的时候是不是要做反量化用FP16计算？

1

RT

转换onnx模型失败

1

hi 我在转换 https://huggingface.co/BAAI/bge-small-en-v1.5/tree/main/onnx 这个模型，遇到下面的错： ``` 2024-07-05 16:21:59.085678: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations. To enable the following instructions: AVX2 FMA, in...