evals icon indicating copy to clipboard operation
evals copied to clipboard

Problem of oaieval.py

Open JimmyThere opened this issue 1 year ago • 2 comments

The oaieval.py still preformed the very first version of the dataset after I updated the jsonl file as the program only execute one item while I have three in my dataset. It looks like the first version had been cached, cause the content in log file created by record.py also didn't the match the dataset, but the content of the first version of my dataset (which means the log file contain content various from dataset). How can I help with this?

JimmyThere avatar Mar 16 '23 12:03 JimmyThere