MTFN-RR-PyTorch-Code icon indicating copy to clipboard operation
MTFN-RR-PyTorch-Code copied to clipboard

some confusion about code

Open sunyue11 opened this issue 3 years ago • 1 comments

sorry,I want to ask if you use the re-ranking in your code, because the loss function seem the same as the ranking loss.and it seems like that you do not construct text-text fusion

sunyue11 avatar Oct 30 '20 09:10 sunyue11

Hi, sorry for the late reply. The re-ranking is exactly used and it's a kind of "an after treatment". As discussed in paper, the rerank is not a loss during training, but more like an algorithm running in just few seconds. In this code base the text-text fusion is not included because of my bandwidth. However it's very similar to the image-text fusion network but just change the input to text-text. Please refer to issue #1 for the detail about text-text fusion and reranking.

Wangt-CN avatar Dec 10 '20 13:12 Wangt-CN