GPT2 icon indicating copy to clipboard operation
GPT2 copied to clipboard

Published 20 hours ago • verified publisher icon ConnorJL

Training 1.5B?

Open JulesGM opened this issue 3 years ago • 0 comments

Hello,

I was wondering if you were able to train the 1.5B model or the large model on TPUs? Afaik it's too large to fit. I would really like to know if you did succeed. Thanks.

JulesGM avatar Nov 16 '20 22:11 JulesGM