TouchStone
TouchStone copied to clipboard
Running eval.py reported an error
When I run it in the console:
python3 eval.py ./touchstone_20230831.tsv sk-*** --model-name gpt-4
console output:
-------------- evaluate gpt-4 -------------
Traceback (most recent call last):
File "eval.py", line 236, in <module>
review_file = process(args.submit_file, args.model_name)
File "eval.py", line 105, in process
assert num_questions == 908, "Insufficient number of answers provided."
NameError: name 'num_questions' is not defined
Also displayed in the editor as num_questions undefined (line: 105)
May I ask how to solve this