[Feature] Support InstructBLIP

[techmonsterwang]

trafficstars

Add InstructBLIP Implementation

[codecov[bot]]

Codecov Report

Patch coverage: 33.72% and project coverage change: -3.03 :warning:

Comparison is base (f9dcae2) 68.16% compared to head (8c43282) 65.13%.

:exclamation: Current head 8c43282 differs from pull request most recent head 807ce32. Consider uploading reports for the commit 807ce32 to get more accurate results

Additional details and impacted files

@@            Coverage Diff             @@
##              dev    #1685      +/-   ##
==========================================
- Coverage   68.16%   65.13%   -3.03%     
==========================================
  Files         295      332      +37     
  Lines       23372    25847    +2475     
  Branches     3713     4130     +417     
==========================================
+ Hits        15932    16836     +904     
- Misses       6880     8393    +1513     
- Partials      560      618      +58     

Flag	Coverage Δ
unittests	65.13% <33.72%> (-3.03%)	:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
mmpretrain/apis/feature_extractor.py	37.50% <0.00%> (ø)
mmpretrain/apis/image_caption.py	30.64% <0.00%> (ø)
mmpretrain/apis/image_retrieval.py	21.42% <0.00%> (ø)
mmpretrain/apis/visual_grounding.py	27.53% <0.00%> (ø)
mmpretrain/apis/visual_question_answering.py	25.67% <0.00%> (ø)
mmpretrain/datasets/__init__.py	60.46% <0.00%> (-13.83%)	:arrow_down:
mmpretrain/datasets/flickr30k_caption.py	0.00% <0.00%> (ø)
mmpretrain/datasets/flickr30k_retrieval.py	0.00% <0.00%> (ø)
mmpretrain/datasets/gqa_dataset.py	0.00% <0.00%> (ø)
mmpretrain/datasets/nocaps.py	0.00% <0.00%> (ø)
... and 65 more

... and 9 files with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

[FDInSky]

when will merge this? we need to use it. Thanks