unilm icon indicating copy to clipboard operation
unilm copied to clipboard

Can kosmos-2 be finetuning with paires of Chinese text and image?

Open KDD2018 opened this issue 9 months ago • 0 comments

I am interested in Kosmos-2 and appreciate it. I want finetune kosmos-2 on my dataset which included images and Chinese texts, but I couldn't do it successfully. So I tried to call Kosmos2Processor on a text, I found it could not be decoded.

image

KDD2018 avatar May 15 '24 07:05 KDD2018