snmn icon indicating copy to clipboard operation
snmn copied to clipboard

What is the memory vector?

Open ggaemo opened this issue 5 years ago • 2 comments

What is the memory vector? It is not mentioned in the paper. In Table 1. in the paper, there are no references to a memory vector. Also in the "mem_out" variable, it shows that c_i is also inside it, which is not as described in Table 1.

ggaemo avatar Mar 08 '19 00:03 ggaemo

Hi, the mem_out variable is only used in DescribeOne and DescribeTwo modules to output information encoding the answer (in other modules, the mem_out is zero, and in NoOp, it gets passed unchanged).

It is soft-averaged here and then used here to predict the answer.

ronghanghu avatar Mar 09 '19 01:03 ronghanghu

Thank you for your response. In the ECCV paper, there is no element of memory vector. In Table 1., there is no recursive behavior. It seems that 'y' in Table 1. refers to the memory vector. Is it right?

ggaemo avatar Mar 12 '19 01:03 ggaemo