Patrick Fernandes

What solved it for me was unregistering Arch with (in CMD/Powershell): ``` wsl --unregister Arch ```

I'm currently on vacations, I'll need to double check if I have the rights to publish the processed dataset when I'm back to work next week. I'll also investigate the...

Ye this one will be in the end of the backlog since I don't have too much time at the moment, but feel free to update it, would be appreciated.

+1! Started to play with https://github.com/google/maxtext but immediately ran into Pallas/Jax-Triton errors and after some effort haven't been able to get a working jax build with Pallas/jax-triton working.

Hmm thats weird, did you run into similar problems @ioana-blue ?

Even though a good amount of data is necessary for good results you shouldn't be seeing always the same words. They were for the full dataset, but one thing I've...

@shandou I think found the problem, is some weird issue with tensorflow not checkpointing some variables (might be caused by a new version of tensorflow). I assume @ioana-blue doesnt get...

Sure, it is in my GitHub profile

I didn't work on this part, but do you have statistics for the prevalence of the malformed tags? If it's very small and it doesn't break the code it prob...