Chinese-LLaMA-Alpaca icon indicating copy to clipboard operation
Chinese-LLaMA-Alpaca copied to clipboard

Feature/quantization/langchain——can run local get the same result of big model

Open HardSoft2023 opened this issue 1 year ago • 0 comments

1、simplfy the langchai_qa.py demo code so that it can run locally ChinesePR

2、python langchain_qa_quantization.py --model_path path/to/chinese_alpaca_plus_pth/7B/ggml-model-q4_0.bin --file_path doc.txt

HardSoft2023 avatar May 20 '23 16:05 HardSoft2023