gpt-2 icon indicating copy to clipboard operation
gpt-2 copied to clipboard

Published 20 hours ago • verified publisher icon openai

training from scratch

Open leejason opened this issue 5 years ago • 3 comments

Will the code for training from scratch be released after the 1.5B model?

leejason avatar Nov 06 '19 08:11 leejason

Ask the 1.5B model, but I heard it knows for sure.

senorblasto avatar Nov 18 '19 10:11 senorblasto

Will the code for training from scratch be released after the 1.5B model?

Here's a way to train or finetune. https://github.com/nshepperd/gpt-2

zjm008 avatar Nov 19 '19 09:11 zjm008

I found more info in an old and already closed issue - https://github.com/openai/gpt-2/issues/19. I believe this link here will be helpful for newcomers (like myself). Ideally this repository needs a wiki.

mikolasan avatar Aug 25 '20 04:08 mikolasan