Data Generation Code

[muelletm]

Hi!

Thanks for releasing this!

From what I saw you did not release the code that was used to synthesize the pre-training data. Is that correct? Are you planning to release it?

Thanks a lot!

[shuxiaobo]

sampe questoin of data generation The pretrain code split the data line by chat 's', but no 's' in the release data