Linly icon indicating copy to clipboard operation
Linly copied to clipboard

怎么转换成hf的格式,我想转换成GPTQ的量化格式

Open edsky opened this issue 2 years ago • 1 comments

如题,调用 convert_llama_weights_to_hf.py 后失败,显示如下: FileNotFoundError: [Errno 2] No such file or directory: '../ChatLLaMA/7B/consolidated.00.pth'

如果通过GPTQ量化后可以在8G显卡上进行推理

edsky avatar Apr 06 '23 10:04 edsky

hf转换脚本还在构建中

ydli-ai avatar Apr 10 '23 03:04 ydli-ai