seq2seq.pytorch
seq2seq.pytorch copied to clipboard
How to use GNMT model?
I did not see it in model.py's all list
Hi~ Maybe , you need to configure the parameter "-model_config" by yourself to achieve the setting as GNMT
Did someone configured a GNMT model and willing to share it?
Here is my model configuration, what do you think?
{'hidden_size': 1024, 'dropout': 0.2, 'forget_bias': 1.0, 'residual': True,
'tie_embedding': True, 'transfer_hidden': False,
'encoder': {'num_layers': 4, 'bidirectional': True, 'num_bidirectional': 1, 'pack_inputs': False},
'decoder': {'num_layers': 4, 'concat_attention': True,
'attention': {'mode': 'bahdanau', 'normalize': True, 'dropout': 0, 'output_transform':
True, 'output_nonlinearity': 'tanh'}
}
}