Enes Altınışık

I resolved this issue by first running the process on a single node, using the "cache_dir" parameter to save the tokenized dataset. After that, I proceeded with running the process...