llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Misc. bug: Failed to convert `MiniCPM-o-2_6`

Open apepkuss opened this issue 1 month ago • 1 comments

Name and Version

By following the steps in the Usage of MiniCPM-o 2.6 section, failed to convert PyTorch model to gguf files:

sam@sam-pc:~/workspace/llama.cpp$ python ./examples/llava/minicpmv-surgery.py -m /home/sam/workspace/models/MiniCPM-o-2_6
Traceback (most recent call last):
  File "/home/sam/workspace/llama.cpp/./examples/llava/minicpmv-surgery.py", line 11, in <module>
    model = AutoModel.from_pretrained(args.model, trust_remote_code=True, local_files_only=True, torch_dtype=torch.bfloat16)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sam/miniconda3/envs/facet/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 553, in from_pretrained
    model_class = get_class_from_dynamic_module(
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sam/miniconda3/envs/facet/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 552, in get_class_from_dynamic_module
    return get_class_in_module(class_name, final_module, force_reload=force_download)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sam/miniconda3/envs/facet/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 237, in get_class_in_module
    module_files: List[Path] = [module_file] + sorted(map(Path, get_relative_import_files(module_file)))
                                                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sam/miniconda3/envs/facet/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 128, in get_relative_import_files
    new_imports.extend(get_relative_imports(f))
                       ^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/sam/miniconda3/envs/facet/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 97, in get_relative_imports
    with open(module_file, "r", encoding="utf-8") as f:
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/home/sam/.cache/huggingface/modules/transformers_modules/MiniCPM-o-2_6/image_processing_minicpmv.py'

Operating systems

No response

Which llama.cpp modules do you know to be affected?

No response

Command line


Problem description & steps to reproduce

  1. Check out b4525 and build the code
  2. Run git clone [email protected]:openbmb/MiniCPM-o-2_6
  3. In the root directory of llama.cpp, run python ./examples/llava/minicpmv-surgery.py -m ../MiniCPM-o-2_6

First Bad Commit

No response

Relevant log output


apepkuss avatar Jan 22 '25 09:01 apepkuss