Bo Li
Bo Li
补充,修改过 clip->siglip ``` image_processor = dict( type=SiglipImageProcessor.from_pretrained, pretrained_model_name_or_path=visual_encoder_name_or_path, trust_remote_code=True) model = dict( type=LLaVAModel, freeze_llm=True, freeze_visual_encoder=True, llm=dict( type=AutoModelForCausalLM.from_pretrained, pretrained_model_name_or_path=llm_name_or_path, trust_remote_code=True), visual_encoder=dict( type=SiglipVisionModel.from_pretrained, pretrained_model_name_or_path=visual_encoder_name_or_path)) ```
报错的不是 transformers/models/llava_next/processing_llava_next.py 而是llamafactory 的代码 而是这 src/llamafactory/data/mm_plugin.py", line 396, ``` Traceback (most recent call last): File "/home/users/code/LLaMA-Factory/src/llamafactory/launcher.py", line 23, in launch() File "/home/users/code/LLaMA-Factory/src/llamafactory/launcher.py", line 19, in launch run_exp() File "/home/users/code/LLaMA-Factory/src/llamafactory/train/tuner.py", line...