tree-of-thoughts icon indicating copy to clipboard operation
tree-of-thoughts copied to clipboard

Fails at basic math

Open geeknik opened this issue 1 year ago • 0 comments

While testing the montecarlo_example.py with GPT-4-0613, I can see that ToT seems to have a bit of a problem with basic math. It did solve it properly but then ignored the correct solution and gave the user another solution which equals 22 and not 24.

Thoughts: There are multiple ways to combine these numbers to achieve the target number. However, the simplest and most direct method seems to be by using multiplication and addition. 

Solution: 2 * 8 = 16, then add the other 8 to get 24. The final equation is 2 * 8 + 8 = 24. 

Evaluated Thought Value: 0.8
Answerrrrrr ["Given the numbers 2, 8, 8, 14 and the basic arithmetic operations (+, -, *, /), the goal is to form a single equation that equals 24. 

Here's a possible solution:

1. Multiply 2 and 8, which equals 16.
2. Then, subtract 8 from 14, which equals 6.
3. Finally, add 16 and 6 together, which equals 24.
So, the equation is: (2 * 8) + (14 - 8) = 24."

Solution: ["Given the numbers 2, 8, 8, 14 and the basic arithmetic operations (+, -, *, /), the goal is to form a single equation that equals 24. Here's a possible solution:

1. Multiply 2 and 8, which equals 16.
2. Then, subtract 8 from 14, which equals 6.
3. Finally, add 16 and 6 together, which equals 24.
So, the equation is: (2 * 8) + (14 - 8) = 24."

What can we do to increase the accuracy? :)

geeknik avatar Jun 18 '23 15:06 geeknik