gpt-2-Pytorch

gpt-2-Pytorch copied to clipboard

Train

1

graykode

training

10

Is there's any way to train GPT2 using my own text corpus?

armoreal

Missing requirements

1

It needs these packages as well so I guess they need to go into requirements.txt: torch tqdm

davidc

Very interesting

snznmltn

I have been using an implementation of GPT-2 from your repository and noticed that the size of the smallest GPT-2 model available in the repository differs from the smallest model...

mmdalix

Thank you for this project! It is very helpful for me to understand how GPT2 synthesize text. I also noticed that the [`GPT2/encoder.py`](https://github.com/graykode/gpt-2-Pytorch/blob/master/GPT2/encoder.py) does not implement the capability of recognizing...

wangkuiyi

"Hi, I am reading the GPT-2 paper and encountering a problem with the following phrase related to implementation: 'A modified initialization method is used to account for the accumulation on...

sanhai77

# Add Python Testing Infrastructure ## Summary This PR establishes a comprehensive testing infrastructure for the GPT-2 PyTorch implementation project using Poetry as the package manager and pytest as the...

llbbl