MNMT

MNMT copied to clipboard

strange results

4

``` Loading train dataset from data/m30k.train.1.pt, number of examples: 29000 data_type: text * vocabulary size. source = 8505; target = 9391 Building model... Initializing model parameters. NMTImgDModel( (encoder): RNNEncoder( (embeddings):...

Eurus-Holmes

multimodal: initialize hidden state of encoder + transformer

2

Hi, could you please tell me how using the Image as additional data to initialise the encoder hidden states (Calixto et al., 2017) take place when implemented with the transformer...

LinuxBeginner