GPT2-Estimator

What is this project?

An implementation of GPT2 using the tf.estimator API. Now GPT2 training can be run with Multiple GPUs!

Why would I need this?

• Easier training and inference
• Train on multiple GPUs
• All the goodies that tf.estimator provides
• TF 2.0 compatible

Reference:

• OpenAI GPT-2 code
• gpt-2-simple