Ask-Anything icon indicating copy to clipboard operation
Ask-Anything copied to clipboard

VideoChat2, 仅finetune stage3后,视频描述存在大量重复

Open ruishuzhao opened this issue 3 months ago • 3 comments

作者好, 通过对videochat2中第三阶段的训练(训练集数据均来源于论文中提供的数据集),通过训练后模型对视频进行描述,会出现大量重复语句。 提问内容为:"Describe the following video clip in detail." 回答如:"The video clip shows a woman wearing a black shirt and black pants standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a" 其中反复出现“The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. ”。

针对这种finetune后出现重复的问题,有比较好的解决方案吗?

辛苦帮忙解答一下。多谢~

ruishuzhao avatar Mar 14 '24 12:03 ruishuzhao