Ask-Anything
Ask-Anything copied to clipboard
VideoChat2, 仅finetune stage3后,视频描述存在大量重复
作者好, 通过对videochat2中第三阶段的训练(训练集数据均来源于论文中提供的数据集),通过训练后模型对视频进行描述,会出现大量重复语句。 提问内容为:"Describe the following video clip in detail." 回答如:"The video clip shows a woman wearing a black shirt and black pants standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a" 其中反复出现“The woman is wearing a black shirt and black pants and is standing in a dark room. She is holding a white shirt and putting it into a washing machine. ”。
针对这种finetune后出现重复的问题,有比较好的解决方案吗?
辛苦帮忙解答一下。多谢~