Is llama2-7B-chat weaker thank llama2-7B?

[sunyuhan19981208]

I got only 9.7% for llama2-7B-chat on human-eval using your script

{'pass@1': 0.0975609756097561}

[abacaj]

Hi, I think you will have to make sure the prompt template is correct