ViP-LLaVA

ViP-LLaVA copied to clipboard

[Question] Finetune Stage 2 Model

3

### Question First of all, great work and thank you so much for open-source it! I wonder if the stage 2 model(referred as ViP-LLaVA-Base) has been released anywhere? Maybe mucai/vip-llava-13b-pretrain?...

Xuefei98

[Issue] Tensor mismatch at Runtime

5

### RuntimeError: The expanded size of the tensor (628) must match the existing size (129) at non-singleton dimension 3. Target sizes: [1, 32, 1, 628]. Tensor sizes: [1, 1, 1,...

RatraSahil

[Usage] pre-requisites for multi-image and multi-prompt generation

3

### Describe the issue Hi there, thank you for sharing this awesome project. I have one question about the requried packages for multi-image and multi-prompt generation. In the following link,...

sykverse

[Discussion] Unable to use the demo

6

### Discussion Thanks for your work, but the demo is hard to use, especially the module of 'Upload images'. Is there any solution to upload my own images successfully?

ymmhcm

[Question] On the test set used for inference evaluation

1

### Question Hi, thanks for your contribution. Could you please provide the test set link or converted file used in docs/Evaluation.md?

mary-0830

Can u provide the subset only for ViP except llava mix original?

5

So that it can not be easily missleading model using llava original dataset. Meanwhile, it looks like the images are missing.. "id": "vcr-52941", "image": "vcr1images/lsmdc_3034_IDES_OF_MARCH/[email protected]", "meta_dir": "./dataset/vcr1images/lsmdc_3034_IDES_OF_MARCH/[email protected]", "class_names": [ "person",

lucasjinreal

[Question] How to get the VIP-Bench?

4

### Question Hello @mu-cai , Thanks for your excellent work. How can we get the VIP-Bench?

KainingYing

[Question] The demo collapse

3

### Question can't use the demo

JustinKai0527

[Discussion] information leakage while intaking the conversition?

1

### Discussion Hi, I have one concern about the model taking in the conversation. One conversation might have multiple questions and answers and it seems (from my understanding) the model...

james20141606

[Usage] pip install issue

1

### Describe the issue Issue: pip install different version with your version which mention in [issue#24](https://github.com/WisconsinAIVision/ViP-LLaVA/issues/24#issuecomment-2256470278) Command: ``` git clone https://github.com/WisconsinAIVision/ViP-LLaVA.git conda create -n vip-llava python=3.10 -y conda activate vip-llava...

JustinKai0527