lm-evaluation-harness icon indicating copy to clipboard operation
lm-evaluation-harness copied to clipboard

coqa not working

Open lchu-ibm opened this issue 11 months ago • 2 comments

This happened once before and got fixed: https://github.com/EleutherAI/lm-evaluation-harness/issues/898

But now it seems not working again with same error, at least on my end.

  File "/home/lchu/.conda/envs/main/lib/python3.9/site-packages/datasets/builder.py", line 1726, in _prepare_split_single
    for key, record in generator:
  File "/lustre/.cache/huggingface/modules/datasets_modules/datasets/EleutherAI--coqa/9ee0502938f8c0d66e6801438f1d1814a99e5a6cbe1e4298869bfb62c2c7596d/coqa.py", line 183, in _generate_examples
    data = json.load(f)
  File "/home/lchu/.conda/envs/main/lib/python3.9/json/__init__.py", line 293, in load
    return loads(fp.read(),
  File "/home/lchu/.conda/envs/main/lib/python3.9/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/home/lchu/.conda/envs/main/lib/python3.9/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/home/lchu/.conda/envs/main/lib/python3.9/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

lchu-ibm avatar Mar 05 '24 15:03 lchu-ibm