tensor2tensor
tensor2tensor copied to clipboard
tensorflow
Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
This script is harmful because it propagates a non-standard way to compute BLEU that is not reflective of the WMT 2014 task. Entirely too many papers are submitted with BLEU...
Fixes compatibility issue with tf2.
### Description ... ### Environment information ``` OS: $ pip freeze | grep tensor # your output here $ python -V # your output here ``` ### For bugs: reproduction...
### Description ... ### Environment information ``` OS: $ pip freeze | grep tensor # your output here $ python -V # your output here ``` ### For bugs: reproduction...
https://github.com/tensorflow/tensor2tensor/blob/5623deb79cfcd28f8f8c5463b58b5bd76a81fd0d/tensor2tensor/layers/area_attention.py#L415 In typical dot product attention, logit which is the input matrix of softmax supposed to be divided by square rooted temperature like the equation below.  However, in this...
### Description It seems that the fc layer of the moe type has not been implemented... In tensor2tensor/layers/common_attention.py:289 , I can't find the the fc layer of the moe type....
### Description When running Cells on google Colab, second cell gives error ### Environment information google colab ``` OS: Linux $ pip freeze | grep tensor # your output here...
when I run TransformerVisualization.ipynb, it shows right output_string, but doesn't show any visualizations. 
Metadata
Owner
Metadata
Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.