WizardLM icon indicating copy to clipboard operation
WizardLM copied to clipboard

Published 20 hours ago • verified publisher icon nlpxucan

evaluate_functional_correctness ${output_path}.jsonl 得到的pass@k结果全是1

Open WUHU-G opened this issue 1 year ago • 1 comments

image

WUHU-G avatar Jun 21 '23 10:06 WUHU-G

I think you first need to check whether you have generated the codes correctly. Then check whether you install the humaneval environment correctly. Since your capture only provides limit information, it is hard for me to provide a solution.

ChiYeungLaw avatar Jun 21 '23 11:06 ChiYeungLaw