cceval icon indicating copy to clipboard operation
cceval copied to clipboard

How do I specify different Settings in the code generation script? baseline, retrieval, retrieval w/ ref

Open kartikzheng opened this issue 1 year ago • 1 comments

hi,How do I specify different Settings in the code generation script? baseline, retrieval, retrieval w/ ref. I see that the data set only contains three different retrievers: bm25, UniXCoder and OpenAI Ada. thanks.

kartikzheng avatar May 08 '24 03:05 kartikzheng

use_crossfile_context controls whether it is a baseline or with retrieval. retrievaland retrieval w/ ref are noted in the filepath of the prompt file: former is rg1 and later is orcale.

zijwang avatar Jul 07 '24 04:07 zijwang