the-pile icon indicating copy to clipboard operation
the-pile copied to clipboard

Published 20 hours ago • verified publisher icon EleutherAI

Question regarding Shuffling

Open LeoXinhaoLee opened this issue 1 year ago • 1 comments

Hi, thank you very much for releasing this great dataset. I am wondering if the original PILE dataset (with 30 chunks) have already shuffled? Or do we still need to globally shuffle PILE before using it for pertaining? Thank you.

LeoXinhaoLee avatar Jan 03 '24 01:01 LeoXinhaoLee

Hi, @LeoXinhaoLee I am also curious about it. Are there any conclusions?

yuzc19 avatar Jan 25 '24 15:01 yuzc19