Cody Blakeney
Cody Blakeney
I'm going to close this issue for the moment as this is a problem with huggingface. The alternative would be to rewrite our json script to make a dataset for...
Hi @germanjke so right now the script only works on c4 and the pile. We are planning on extending it to work for any hugging face datasets soon.
if you provide a local and a remote the shards will download from s3 to the location of the local directory. If you do further runs it will check if...
HI ashoksmavd, Can you provide your yaml so I can have a look?
Have you double checked the correctness of your s3 path and aws permissions? I was going to take a look at how you formated your s3 path but I assume...
I know there is support for MoEs with Mixtral. I'm not sure how much of a lift it will take but I'm willing to help if people can point me...
bump
Any updates?
any update on this?