mingming

Same question.

还是不行，能不能提供一个镜像呢

微调minicpm-v-v2_6-chat出现报错: File "/usr/local/lib/python3.10/dist-packages/torch/_tensor.py", line 491, in backward torch.autograd.backward( File "/usr/local/lib/python3.10/dist-packages/torch/autograd/init.py", line 251, in backward Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass RuntimeError: element 0 of...

@Jintao-Huang 但是设置了--lora_target_modules ALL之后就会显存溢出，原理上应该不应该？ 视觉模块微调用到的显存要小于LLM部分吧 8卡40G A100 File "/root/.cache/huggingface/modules/transformers_modules/glm-4v-9b/visual.py", line 93, in forward x = self.fc1(x) File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl return self._call_impl(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1562, in _call_impl...

+1