neuralmonkey
neuralmonkey copied to clipboard
Not best default
The default output projection https://github.com/ufal/neuralmonkey/blob/master/neuralmonkey/decoders/decoder.py#L151
is tanh instead of relu, which does not reach the best score (I have experimented with this last year a bit). I would suggest to put the defaults as the best setup we know about, the same way as the tensor2tensor do it.