Ahmed Hasssan

icon company Cornell University icon location NYC, NY icon location PhD Scholar, ECEE Department, Cornell University (Tech)

Results 1 issues of Ahmed Hasssan

Taking a few days to complete SlimPajama "Train" data

1 comment

Hi, I just want to know how much time it takes to finish the "train" data preparation using this script. python scripts/prepare_slimpajama.py --source_path /path/to/SlimPajama --tokenizer_path data/llama --destination_path data/slim_star_combined --split train...