LightningDOT

LightningDOT copied to clipboard

Gradiant overflow in finetuning

2

Hi, Thank you very much for the great work, and for sharing the fine-tuning data last week. I got an issue when I tried to fine-tune and evaluate the model...

ghaddarAbs

Cross-modal Retrieval Objective (CMR)

6

Can you point me to the place in your code where CMR is implemented? You used CMR + VMLM + SMRM for the pre-training, according to the paper. However, CMR...

mojivalipour

Pretraining dataset

5

Hi, Thank you very much for the great work, and for making your code publicly available. I am trying to run the code to reproduce the results, however, the pre-training...

ghaddarAbs

Demo Notebook

1

Hi @intersun @ChenRocks Can you share the data checkpoints used in Image_retriever.ipynb? And if you can share any updated notebook that can be used as a demo to check what...

shivangibithel

Paper pretraining config

1

It appears that config/pretrain-alldata-base.json is not your paper pretraining configuration. There is no cls_concat setting in this configuration file, so it uses the default value. As a result, unlike your...

mojivalipour

coco_cap dataset

1

Hello, Just a quick question. As far as I can see, coco_cap dataset is not shared in lightningDOT repo. I have been able to download coco_cap dataset from Uniter repo...

mattgithub1919