Jason Banner

Request for Ground Truth Solutions to Enhance Test Coverage

1

Thank you for the outstanding work. May I ask if it is possible to also provide the Ground Truth Solution? I’ve noticed that some of the private cases are not...

I used the default command: ```bash PROMPT_TYPE="qwen25-math-cot" MODEL_NAME_OR_PATH="Qwen/Qwen2.5-Math-7B-Instruct" bash sh/eval.sh $PROMPT_TYPE $MODEL_NAME_OR_PATH ``` With the following default setup: ```bash DATA_NAME="gaokao2024_I,gaokao2024_II,gaokao2024_mix,gaokao_math_cloze,gaokao_math_qa" TOKENIZERS_PARALLELISM=false \ python3 -u math_eval.py \ --model_name_or_path ${MODEL_NAME_OR_PATH} \ --data_name...