CRIS.pytorch
CRIS.pytorch copied to clipboard
An official PyTorch implementation of the CRIS paper
Are there any plans to host a pre-trained CRIS model on e.g. huggingface? Looking forward to trying out the model!
Hi, I found that the loss used in this repo is a cross-entropy loss between prediction and mask. `loss = F.binary_cross_entropy_with_logits(pred, mask)` But the loss mentioned in the paper is...
Hi @DerrickWang005, did you guys try an experiment with the VIT as the image backbone instead of the Resnet. CLIP says the VIT backbone worked better for the contrastive part....
How to train model on a single GPU
**I trained a best_model.pth according to the instructions in github, but after entering the evaluation instructions, an error occurred: ValueError: operands could not be broadcast together with shapes (480,640) (640,427)**...
Hello, I notice that you use validate function during training while using inference function during testing, and the calculated results of these two functions for the same checkpoint are different....
Can you provide the code to calculate the validate loss? Try to calculate the validate loss, but the curve is strange
Hello, I would like to know why the error AttributeError: module 'pyarrow' has no attribute 'deserialize' is reported, and what should be the correct version?