cceval
cceval copied to clipboard
How do I specify different Settings in the code generation script? baseline, retrieval, retrieval w/ ref
hi,How do I specify different Settings in the code generation script? baseline, retrieval, retrieval w/ ref. I see that the data set only contains three different retrievers: bm25, UniXCoder and OpenAI Ada. thanks.
use_crossfile_context controls whether it is a baseline or with retrieval.
retrievaland retrieval w/ ref are noted in the filepath of the prompt file: former is rg1 and later is orcale.