TouchStone icon indicating copy to clipboard operation
TouchStone copied to clipboard

Running eval.py reported an error

Open nextdoorUncleLiu opened this issue 1 year ago • 0 comments

When I run it in the console:

python3 eval.py ./touchstone_20230831.tsv sk-*** --model-name gpt-4

console output:

 -------------- evaluate gpt-4 -------------
Traceback (most recent call last):
  File "eval.py", line 236, in <module>
    review_file = process(args.submit_file, args.model_name)
  File "eval.py", line 105, in process
    assert num_questions == 908, "Insufficient number of answers provided."
NameError: name 'num_questions' is not defined

Also displayed in the editor as num_questions undefined (line: 105)

May I ask how to solve this

nextdoorUncleLiu avatar Aug 09 '24 07:08 nextdoorUncleLiu