wangxinliang
wangxinliang
0 or 1 is about the last sentence in a paragraph. For example, a paragraph 'the lung is clear. no acute cardiopulmonary abnormality. no acute cardiopulmonary abnormality.' will be labeled...
Is there any experimental or theoretical evidence supporting the statement 'pairing the InternViT-6B with a 20B or 30B language model'? @czczup
@htian01 i think this is the finetuning data for internvl-chat-v1.2, not for v1.2 plus.
Every time we adjust the visual encoder, we have to go through a long pre-training process (freezing the LLM, unfreezing the MLP, using around 40M data from the v1.2 version)...