how do I train gpt-2 using multiple encoding files?

Open ca3games opened this issue 5 years ago • 1 comments

Hi, I just got gpt-2 working under google collab.

I have two questions: How much epochs do I need to let it run? How do I train gpt-2 using multiple encoding files?

Many thanks.

Sep 25 '20 04:09 ca3games

Those are much more complex than what you'll find on google. The only way to do what you are asking is to hire a data scientist, will run you about $75,000 on average. No less than $65,000.00 USD.

Dec 02 '20 23:12 arturogatti