DSI-QG icon indicating copy to clipboard operation
DSI-QG copied to clipboard

Reproduce hit@10 is zero

Open bit-pku-zdf opened this issue 1 year ago • 2 comments

Hi,I want to evaluate the DSI performance, use the command , image , and train 5000steps ,hits@10 is zero,Could you push the right evaluation result.Thank you !

bit-pku-zdf avatar Apr 21 '23 08:04 bit-pku-zdf

Hi @bit-pku-zdf, the original DSI indeed performs very badly on cross-lingual retrieval tasks, this is actually expected. For the full run results, you can check our paper (table2).

ArvinZhuang avatar Apr 21 '23 08:04 ArvinZhuang

Get it, Thanks~

bit-pku-zdf avatar Apr 21 '23 08:04 bit-pku-zdf