creative-writing-with-gpt2 icon indicating copy to clipboard operation
creative-writing-with-gpt2 copied to clipboard

What size GPT-2 model is used?

Open liamvgallagher opened this issue 2 years ago • 1 comments

I couldn't figure out if it was small, medium large etc. Is there a way to change which model is used for training?

liamvgallagher avatar Jan 12 '23 03:01 liamvgallagher

The model is set in a function load_checkpoint:

https://github.com/ADGEfficiency/creative-writing-with-gpt2/blob/b0e59aa92e90dffa3fe3461eb5447782624774fd/creative/evaluate.py#L22

You may want to look at:

https://github.com/ADGEfficiency/creative-writing-with-gpt2/blob/b0e59aa92e90dffa3fe3461eb5447782624774fd/creative/evaluate.py#L38

ADGEfficiency avatar Feb 12 '23 07:02 ADGEfficiency