LAVIS icon indicating copy to clipboard operation
LAVIS copied to clipboard

Is it possible to do "Multi-round Chatting" with InstructBLIP?

Open dongmean opened this issue 1 year ago • 2 comments

Hi, thanks for the great work!

I'm wondering if InstructBLIP allows multi-round chatting, e.g., <Img, Q1, A1, Q2, ?>, so that it can support in-context learning in a dialogue. If so, which python script can I refer to? It seems the demo (https://replicate.com/gfodor/instructblip) does not allow the multi-round consecutive questions.

Thanks again for your amazing contributions.

dongmean avatar Jul 18 '23 01:07 dongmean

This may be what you are looking for: https://colab.research.google.com/github/salesforce/LAVIS/blob/main/examples/blip2_instructed_generation.ipynb

MiaQiu avatar Jul 21 '23 08:07 MiaQiu

Have you found a method? I also want to do a In-context learning experiment.

Fym68 avatar Mar 29 '24 11:03 Fym68