Very-Deep-Convolutional-Networks-for-Natural-Language-Processing-in-tensorflow
Very-Deep-Convolutional-Networks-for-Natural-Language-Processing-in-tensorflow copied to clipboard
Incorrect batch_norm usage
- The
trainable
argument in the batch_norm op should be replaced withis_trainable
. - I think the starting convolution layer is incorrect. In my opinion, this stride should be [1, 1, ,1, 1] instead of [1, 1, embedding_size, 1], and
padding=Valid
instead ofpadding=Same
should be used.