lm-evaluation-harness
lm-evaluation-harness copied to clipboard
coqa not working
This happened once before and got fixed: https://github.com/EleutherAI/lm-evaluation-harness/issues/898
But now it seems not working again with same error, at least on my end.
File "/home/lchu/.conda/envs/main/lib/python3.9/site-packages/datasets/builder.py", line 1726, in _prepare_split_single
for key, record in generator:
File "/lustre/.cache/huggingface/modules/datasets_modules/datasets/EleutherAI--coqa/9ee0502938f8c0d66e6801438f1d1814a99e5a6cbe1e4298869bfb62c2c7596d/coqa.py", line 183, in _generate_examples
data = json.load(f)
File "/home/lchu/.conda/envs/main/lib/python3.9/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/home/lchu/.conda/envs/main/lib/python3.9/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/home/lchu/.conda/envs/main/lib/python3.9/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/home/lchu/.conda/envs/main/lib/python3.9/json/decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)