MathPile icon indicating copy to clipboard operation
MathPile copied to clipboard

Dataset code

Open StellaAthena opened this issue 1 year ago • 1 comments

There does not appear to be any code related to how the dataset was collected, filtered, and cleaned. When is that going to be released?

StellaAthena avatar Jan 02 '24 19:01 StellaAthena

Thank you very much for your valuable feedback.

We are currently dedicating our efforts to refining our datasets and enhancing the quality of our data, alongside progressing with model training. Please rest assured that the release of the preprocessed code is on our agenda. We are diligently working towards making it available soon. Your patience and understanding in this matter are greatly appreciated.

SinclairCoder avatar Jan 06 '24 05:01 SinclairCoder

Scripts for preprocessing and global data processing have been updated. Please feel free to take a look at it.

SinclairCoder avatar Jun 23 '24 11:06 SinclairCoder