evals
evals copied to clipboard
Request to change arithmetical_puzzles prompting
Describe the feature or improvement you're requesting
arithmetical_puzzles prompts does not allow proper reasoning The following is added at the end of every prompt..."Do not give any reasoning or logic for your answer."
In a previous PR, usama-openai requested to change the prompting of eval math_for_5th-grader to add better prompting to allow the LLM to reason.
https://github.com/openai/evals/pull/1293#pullrequestreview-1517023638
Request to change the prompt for arithmetical_puzzles as well.
Additional context
No response