MiniCPM icon indicating copy to clipboard operation
MiniCPM copied to clipboard

MiniCPM3微调

Open lifelsl opened this issue 1 year ago • 3 comments

请问一下MiniCPM3微调的时候可以按照minicpm-2b微调的方式吗,还是说只能按照你们给的用llama-factory的方式

lifelsl avatar Sep 13 '24 01:09 lifelsl

I also have this question. Fine tuning with loRA can lead to errors

ValueError: Target modules {'v_proj', 'q_proj'} not found in the base model. Please check the target modules and try again.

lewiswlker avatar Sep 13 '24 02:09 lewiswlker

你好,这一块我们正在适配,请先使用llamafactory吧

LDLINGLINGLING avatar Sep 13 '24 02:09 LDLINGLINGLING

@LDLINGLINGLING 请问什大概什么时候可以适配完

lifelsl avatar Oct 11 '24 06:10 lifelsl

请参考MiniCPM 知识库中的相关内容。

zh-zheng avatar Jun 07 '25 03:06 zh-zheng