Cody Blakeney
Cody Blakeney
I’m willing to help out if needed. I have been working on getting a central webdataset / AIStore working for my universities lab and have also been tinkering with PyTorch...
I got the same error are detectRecog after downgrading to NDK 15. I also tried NDK 16 and got the same message. maybe it is a problem with setting up...
This is an expected outcome. This is described in the documentation. The library automatically handles the pruning of residual connections. Because you pruned a layer just before the skip connection...
Any progress on this? I would like to help if needed @VainF @tchaton
hey @casperbh96 this all looks great. Yeah if you could add it to `convert_finetuning_dataset.py` script, and remove the `build_dataloader` from the `convert_dataset_json.py` I'll approve the changes.
Did this resolve your issue @tginart?
I'll give it a look. Thanks for bringing that to our attention.
I'll take a look at this. Thanks for bringing it to our attention.
hey @nikhilranjan7 do you have the same issue if you try converting a single .jsonl file from Red Pajamas? I'm wondering if this is a result of the pipe you...
@nikhilranjan7 I think I have figured out the issue here. It seems to be an issue with huggingface datasets. When I tested multiple .jsonl files using redpajama's arxiv files it...