GODEL icon indicating copy to clipboard operation
GODEL copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Reddit Data

Open KeremTurgutlu opened this issue 1 year ago • 3 comments

Data preparation involves downloading reddit comment and submission data form https://files.pushshift.io/reddit/ and it is written that total data is around 700GB. However, the actual size of the data is around ~2TB, for training GODEL unitl which YYYY-MM reddit data you've used?

KeremTurgutlu avatar Feb 18 '23 06:02 KeremTurgutlu