Shivam Agarwal

icon company University of Illinois at Urbana Champaign icon location USA

Results 2 comments of Shivam Agarwal

Single-line Infilling Results reproduction

Thanks! Using a stopping condition like \n reproduces the numbers.

BBH, gsm8k benchmark accuracy mismatch with paper

I was able to get 13.2% (the paper reports 14.6%) for llama2 7b by changing \n\n to \n\n\n. There is also an extra space in the target filtering before the...