auto-cot icon indicating copy to clipboard operation
auto-cot copied to clipboard

GSM8K few-shot sampling from test set?

Open GasolSun36 opened this issue 1 year ago • 1 comments

Excellent work! However, in your paper page 19, Appendix D, you show automatically constructed demonstrations for GSM8K. However, I find that these 8 cases are from test.jsonl but not train.jsonl. Is there a data leak problem?

GasolSun36 avatar Mar 08 '23 13:03 GasolSun36