attention-is-all-you-need-pytorch
attention-is-all-you-need-pytorch copied to clipboard
Compare results between this one and the Tensorflow one
Can you give some comparative experiment results between this one and Tensorflow one? Do these two performs similar?
repo This repository seems to be the most popular Tensorflow repository for the Transformer. However, the test data seems to be in IWSLT and not WMT. So you may have to test them out yourself. https://ai.googleblog.com/2017/08/transformer-novel-neural-network.html Shows the transformer benchmarks from Google at the time of 2017.