UniVL icon indicating copy to clipboard operation
UniVL copied to clipboard

Estimate of zero-shot performance

Open bpiyush opened this issue 3 years ago • 1 comments

Hi! Thanks for the open-sourced code!

I wonder if you have conducted zero-shot experiments on MSRVTT or other downstream datasets. I get the following performance on standard text-to-video retrieval:

MR             68.5
R1              7.0
R10             23.4
R5             16.6

I am trying to make sure my pipeline is correct (with the UniVL model and my own trainer pipeline). Do you have zero-shot numbers on MSRVTT for comparison?

bpiyush avatar Oct 14 '22 22:10 bpiyush

Hi @bpiyush, sorry for my delayed reply. I am also sorry that we have no results on the zero-shot performance.

ArrowLuo avatar Oct 24 '22 03:10 ArrowLuo