Shivam Agarwal

icon company University of Illinois at Urbana Champaign icon location USA

Results 1 issues of Shivam Agarwal

Single-line Infilling Results reproduction

4 comment

Hello, I am trying to reproduce the infilling results on HumanEval (Table 14 CodeLLAMA 7B SPM, pass@1=83%). I am using the single-line benchmark from https://github.com/openai/human-eval-infilling. I use the below code...