fastllm icon indicating copy to clipboard operation
fastllm copied to clipboard

Published 20 hours ago • verified publisher icon ztxz16

编译完之后运行模型时报错

Open supercj92 opened this issue 6 months ago • 1 comments

报错信息 python3 -m ftllm.chat -t 16 -p ~/llm/fastllm/models/ --dtype int4 Load AutoTokenizer failed. (you can try install transformers) Try load fastllm tokenizer. zsh: segmentation fault python3 -m ftllm.chat -t 16 -p ~/llm/fastllm/models/ --dtype int4

模型版本： chris@B-40THQ05P-2336 build-fastllm % ls ~/llm/fastllm/models/ chatglm2-6b-int4.flm

python版本 Python 3.12.4

操作系统 芯片 Apple M1 操作系统image

supercj92 avatar Aug 09 '24 08:08 supercj92