No such file or directory: '/root/.cache/huggingface/datasets/squad_multitask/highlight_qg_format/1.0.0/dataset_info.json'

[tonyken12345]

When i do python prepare_data.py,Why run out of this message?

[binggoml]

me too,this code has many errors

[JingxinLee]

nlp.utils.info_utils.NonMatchingSplitsSizesError: [{'expected': SplitInfo(name='train', num_bytes=226286197, num_examples=253276, dataset_name='squad_multitask'), 'recorded': SplitInfo(name='train', num_bytes=226284739, num_examples=253275, dataset_name='squad_multitask')}]

[1836533846]

nlp.utils.info_utils.NonMatchingSplitsSizesError: [{'expected': SplitInfo(name='train', num_bytes=226286197, num_examples=253276, dataset_name='squad_multitask'), 'recorded': SplitInfo(name='train', num_bytes=226284739, num_examples=253275, dataset_name='squad_multitask')}]

I am facing the same error, did u solved it dude?

[ZihaoLin0123]

If you check the file data/squad_multitask/dataset_infos.json, you will find: "splits": {"train": {"name": "train", "num_bytes": 226286197, "num_examples": 253276,......

You can change "226286197" to "226284739" and change "253276" to "253275", then you can fix the error.

[William9Baker]

I am facing the same error, do you solved it now?