Longling

icon location Huazhong University of Science and Technology

Results 2 comments of Longling

使用cli_demo.py 跑自己finetune的权重，报错 The size of tensor a (12288) must match the size of tensor b (25165824) at non-singleton dimension 0

我也遇到相同的问题，我用QLora方法跑完官方微调项目。在4090上运行报错，(py310_chat) yl@4-gpu:~/llm_ll/VisualGLM-6B$ CUDA_VISIBLE_DEVICES=1 python cli_demo.py --from_pretrained checkpoints/finetune-visualglm-6b-12-11-16-53/ --prompt_zh 这张图片的背景里有什么内容？ [2023-12-12 12:34:49,199] [INFO] [real_accelerator.py:161:get_accelerator] Setting ds_accelerator to cuda (auto detect) [2023-12-12 12:34:52,703] [INFO] building FineTuneVisualGLMModel model ... [2023-12-12 12:34:52,705] [INFO] [RANK...

加载微调后模型时报错object of type 'QuantState' has no len()

我也遇到相同的问题，怎么解决？