CodeUltraFeedback icon indicating copy to clipboard operation
CodeUltraFeedback copied to clipboard

Published 20 hours ago • verified publisher icon martin-wey

Evaluation for humaneval

Open renmengjie7 opened this issue 1 year ago • 1 comments

What is the processing of the inference and extraction for humaneval? My test score is only 20.73 for humaneval (k=1, model = CodeLlama-7b-Instruct-hf+DPO ).

renmengjie7 avatar Aug 09 '24 05:08 renmengjie7