LAVIS

LAVIS copied to clipboard

Modify BLIP2 pretraining config files to add more dataset

1

Thanks for the great work! The BLIP-2 paper mentions that the model is pre-trained on a combination of dataset, including COCO, Visual Genome, CC, SBU and LAION. Looking at the...

xfgao

Installation error due to conflicting dependencies

4

### Problem Description: Upon attempting to install the salesforce-lavis package, an error occurs due to conflicting dependencies between versions 1.0.0 and 1.0.2. This issue prevents successful installation of the package....

aade-sh

Update requirements.txt, make timm version flexible

1

I'm running into troubles trying to add this package as requirement using poetry, since some of other packages in my lib require higher versions of timm. I tested that your...

bonlime

I hope I can reproduce the instruction blip？Many details are not disclosed, such as data set configuration, task configuration, etc.

GITMrzk

Update Evaluation link

1

CR-Gjx

Please Add load in 8 bits for InstructBLIP

2

Therefore, RTX 3090 users can run the 13B version

MilesQLi

Error installing: salesforce-lavis 1.0.2 depends on decord

9

I'm trying to pip install lavis, but keeps getting this: ``` ERROR: Cannot install salesforce-lavis==1.0.0 and salesforce-lavis==1.0.2 because these package versions have conflicting dependencies. The conflict is caused by: salesforce-lavis...

shakedzy

hello, how can i get the datasets used in InstructBLIP?

Ucas-HaoranWei

Confidence Score

2

How can i use BLIP ITM on text and image to predict confidence score? Any resource or notebook can you share? Is it possible to use lavis?

shengyi4

Reproducing BLIP2 COCO ITM Fine-tuning and Adding New Data

3

Hey BLIP-2 team, Thanks for your great work! I've been trying to reproduce the BLIP2 COCO ITM fine-tuning using the resources in your repo: 1. [train.py](https://github.com/salesforce/LAVIS/blob/main/train.py) 2. [blip_image_text_matching.ipynb](https://github.com/salesforce/LAVIS/blob/main/examples/blip_image_text_matching.ipynb) 3. [train_caption_coco.sh](https://github.com/salesforce/LAVIS/blob/main/run_scripts/blip2/train/train_caption_coco.sh)...

yonatanbitton