byteNet-tensorflow
byteNet-tensorflow copied to clipboard
ByteNet for character-level language modelling
Hi, is it possible to share with us some of your pre-trained models? Thanks.
git diff diff --git a/ByteNet/model.py b/ByteNet/model.py index 4cfe3b3..3a12b5b 100644 --- a/ByteNet/model.py +++ b/ByteNet/model.py @@ -138,7 +138,7 @@ class Byte_net_model: decoder_output = self.decoder(source_embedding) loss = self.loss(decoder_output, target_sentence) - tf.scalar_summary('LOSS', loss) +...
For encoder, the dilated convolution for encoder pads ``` (filter_width - 1) * dilation/2```, this means after reshaping there are ```(filter_width-1)``` zeros at the beginning. But ```conv1d``` uses ```SAME``` padding,...
Could you reproduce the result of language modeling in the original paper?
This pull request eliminates the warnings with the latest TensorFlow version. I have also refactored some functions for better readability. The code now requires Python 3, which lead to further...
Hey awesome implementation. Thanks. In translate.py, when I want to translate a source sentence, I still need to provide a target. Is the target the same as the source? Thanks