Distributed gpt-2-simple project (suggestion)

[simsim314]

As you know GPT-3 is today closed and few people have access to it. GPT-3 can provide some benefits to many people: writers, entrepreneurs, layers etc. etc.

This is why we need something similar to Lc0 project for GPT. We can either distribute the GPT-3 training, or we can have a swarm of GPT-2s that fine tune all the time. Any query will be running on the distributed network (imagine 10,000 gpt-2s will predict the next word - wouldn't it be even better than gpt-3?). Having lots of gpt-2s has benefit of scalability, and we don't need to develop anything except distributing gpt-2-simple to many computers, and write distributed queries.

I'm not an expert in GPT nor in distributed computing, but this sounds like a project that might interest someone who is proficient in gpt-2, and has community of users/supporters. I'm just worried about the gap "open-ai" created by becoming "closed-ai", as it seems they've created something useful, and give this advantage to corporations.