tensor2tensor
tensor2tensor copied to clipboard
What are the transformers that is obviously better than transformer-2017?
The transformer-2017 is described in the paper 《attention is all you need》. Now 3 years past. Are there any transformers that surpass transformer-2017 in most of the task? Speedup without accuracy decreasing is also considered as a better one.
GPT3