llama.cpp
llama.cpp copied to clipboard
Misc. bug: Failed to convert `MiniCPM-o-2_6`
Name and Version
By following the steps in the Usage of MiniCPM-o 2.6 section, failed to convert PyTorch model to gguf files:
sam@sam-pc:~/workspace/llama.cpp$ python ./examples/llava/minicpmv-surgery.py -m /home/sam/workspace/models/MiniCPM-o-2_6
Traceback (most recent call last):
File "/home/sam/workspace/llama.cpp/./examples/llava/minicpmv-surgery.py", line 11, in <module>
model = AutoModel.from_pretrained(args.model, trust_remote_code=True, local_files_only=True, torch_dtype=torch.bfloat16)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/sam/miniconda3/envs/facet/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 553, in from_pretrained
model_class = get_class_from_dynamic_module(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/sam/miniconda3/envs/facet/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 552, in get_class_from_dynamic_module
return get_class_in_module(class_name, final_module, force_reload=force_download)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/sam/miniconda3/envs/facet/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 237, in get_class_in_module
module_files: List[Path] = [module_file] + sorted(map(Path, get_relative_import_files(module_file)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/sam/miniconda3/envs/facet/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 128, in get_relative_import_files
new_imports.extend(get_relative_imports(f))
^^^^^^^^^^^^^^^^^^^^^^^
File "/home/sam/miniconda3/envs/facet/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 97, in get_relative_imports
with open(module_file, "r", encoding="utf-8") as f:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/home/sam/.cache/huggingface/modules/transformers_modules/MiniCPM-o-2_6/image_processing_minicpmv.py'
Operating systems
No response
Which llama.cpp modules do you know to be affected?
No response
Command line
Problem description & steps to reproduce
- Check out
b4525
and build the code - Run
git clone [email protected]:openbmb/MiniCPM-o-2_6
- In the root directory of
llama.cpp
, runpython ./examples/llava/minicpmv-surgery.py -m ../MiniCPM-o-2_6
First Bad Commit
No response
Relevant log output