OFA icon indicating copy to clipboard operation
OFA copied to clipboard

Why are all the sentences generated by image captioning the same sentence?

Open Swieo opened this issue 3 years ago • 3 comments

My dataset is medical images (x-rays), but after fine-tuning , the generated captions of all the images are the same sentence.Is there something else that needs to be modified?Hope the author can give me some advice.

Swieo avatar Nov 08 '22 14:11 Swieo

Any more details? You can first check whether you can reproduce the performance following our instructions for finetuning on coco captions. If everything is alright, you can check your code or provide a colab notebook for us to follow up.

JustinLin610 avatar Nov 10 '22 15:11 JustinLin610

Any more details? You can first check whether you can reproduce the performance following our instructions for finetuning on coco captions. If everything is alright, you can check your code or provide a colab notebook for us to follow up.

Because I just have one not 5 captions about an image, so I didn't do the stage 2 training, is it because of that?

Swieo avatar Nov 12 '22 10:11 Swieo

My dataset is medical images (x-rays), but after fine-tuning , the generated captions of all the images are the same sentence.Is there something else that needs to be modified?Hope the author can give me some advice.

Hi, did you find out the reasons and solutions?

levietthinh avatar Oct 18 '23 06:10 levietthinh