Script for leetcode results

[shenao-zhang]

Hi,

Thanks for your excellent work and code! I have the following two questions in hope to get your clarification.

1. May I know the correct way to reproduce the reflexion results for the leetcode-hard-gym benchmark? Specifically, I tried run_reflexion_py_leet.sh, but I'm not sure what dataset_path to set. The default path does not exist, and the closet one is ./executors/leetcode_env/leetcode_dataset/build/leetcode-hard-uncontaminated-python3.jsonl, which throws an error "KeyError: 'visible_tests'".
2. What does reflexion_ucs stand for?

Any help is very much appreciated!

Best, Shenao

[vinid]

@shenao-zhang were you able to solve this issue? thanks!!