kar9999

Results 6 comments of kar9999

> ** ** commented [on 17 Dec 2021](#issue-1083044163) Hi, I have the same question. Do you have the solution?

> We'll look into this soon and send a fix, but in the meantime, I think replacing `restored_params = tree['opt']['target']` with `restored_params = tree['target']` would solve the issue. Thanks for...

请问是sft阶段还是dpo阶段啊,我在作者的框架下,用sft微调chatglm3 loss也会nan

> > 多张图你是怎么处理的,我用这个格式穿入多张图,模型似乎只能注意到其中一张图 > > 我也不太清楚多图应该怎么处理输入,模型只会看到 最后一张图 兄弟有找到解决办法吗

messages=[{ 'role': 'user', 'content': [{ 'type': 'text', 'text': 'describe this image', }, { 'type': 'image_url', 'image_url': { 'url': 'https://modelscope.oss-cn-beijing.aliyuncs.com/resource/tiger.jpeg', }, { 'type': 'image_url', 'image_url': { 'url': 'https://modelscope.oss-cn-beijing.aliyuncs.com/resource/tiger2.jpeg', }, }], }],我用openai的请求格式,这样是可以的,但是一个content里只能有一个text,多个text只取最后一个...