gemini-benchmark icon indicating copy to clipboard operation
gemini-benchmark copied to clipboard

Double-check filtering of final strings in codegen

Open neubig opened this issue 2 years ago • 0 comments

The results of filtering final strings in codegen is a little bit buggy (I made a temporary patch to get results quickly, but it should be fixed permanently). https://github.com/neulab/gemini-benchmark/blob/fe7a80c9f4423bdca529dfd18691d060f5d61e6e/benchmarking/Code/run_code.py#L126-L130

neubig avatar Dec 22 '23 21:12 neubig