llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

convert.py produces KeyError: ('torch', 'ShortStorage')

Open jckongucsd opened this issue 1 year ago • 0 comments

Here's my error: I'm not sure if it is the pytorch version that's a problem. My version is: Version: 2.2.0 `llama.cpp$ python convert.py ../home/jovyan/llm-awq/quant_cache/TinyLlama-w4-g128_awq.pt --outfile /TinyLlama-1.1B-Chat-v1.0/lol.gguf Loading model file ../home/jovyan/llm-awq/quant_cache/TinyLlama-w4-g128_awq.pt Traceback (most recent call last): File "/llama.cpp/convert.py", line 1548, in main() File "/llama.cpp/convert.py", line 1480, in main model_plus = load_some_model(args.model) File "/llama.cpp/convert.py", line 1369, in load_some_model models_plus.append(lazy_load_file(path)) File "/llama.cpp/convert.py", line 970, in lazy_load_file return lazy_load_torch_file(fp, path) File "/llama.cpp/convert.py", line 926, in lazy_load_torch_file model = unpickler.load() File "/llama.cpp/convert.py", line 915, in find_class return self.CLASSES[(module, name)]

KeyError: ('torch', 'ShortStorage')`

jckongucsd avatar Apr 20 '24 07:04 jckongucsd