InternLM-XComposer icon indicating copy to clipboard operation
InternLM-XComposer copied to clipboard

Thanks for your feedback! Can u retry the latest version?

Open 2132660698 opened this issue 1 year ago • 7 comments

          Thanks for your feedback! Can u retry the latest version?

Originally posted by @yuhangzang in https://github.com/InternLM/InternLM-XComposer/issues/288#issuecomment-2071359528 你好,4.23日13点更新了代码,微调internlm-xcomposer2-4khd-7b报下面的错误,麻烦再看一下: image

2132660698 avatar Apr 23 '24 05:04 2132660698

image

2132660698 avatar Apr 23 '24 05:04 2132660698

Hi, can u post the parameters of your finetune_lora.sh file?

yuhangzang avatar Apr 23 '24 05:04 yuhangzang

image

2132660698 avatar Apr 23 '24 05:04 2132660698

这是我的微调数据,这个数据微调internlm-xcomposer2-vl-7b没有问题。 image

2132660698 avatar Apr 23 '24 05:04 2132660698

This issue is due to the current 4khd fine-tuning code does not support multiple images in one query. Please stay tuned.

yuhangzang avatar Apr 23 '24 06:04 yuhangzang

This issue is due to the current 4khd fine-tuning code does not support multiple images in one query. Please stay tuned.

应该是你说的这个情况,将训练数据中的多图改成一张图后,可以Lora训练完成。

2132660698 avatar Apr 23 '24 07:04 2132660698

请问Lora训练后,可以合并吗?

2132660698 avatar Apr 23 '24 22:04 2132660698

Our IXC 2.5 has supported the multi-round, multi-image fine-tuning. We also provide the LoRA merge scripts here

yuhangzang avatar Jul 22 '24 11:07 yuhangzang