Dongwei Wang
Results
2
comments of
Dongwei Wang
> traindata = load_dataset('allenai/c4', data_files={'train': 'en/c4-train.00000-of-01024.json.gz'}, split='train') > valdata = load_dataset('allenai/c4', data_files={'validation': 'en/c4-validation.00000-of-00008.json.gz'}, split='validation') Solved for me ! Thanks!
Maybe you can try this https://github.com/huggingface/text-generation-inference/commit/773aabdda6197cae3d2092f1cd6d9ce08d649185 @prasanna