rewoo.ipynb example answers incorrectly as of now, using default code and settings

[vanetreg]

Checked other resources

• [X] I added a very descriptive title to this issue.
• [X] I searched the LangChain documentation with the integrated search.
• [X] I used the GitHub search to find a similar question and didn't find it.
• [X] I am sure that this is a bug in LangChain rather than my code.

Example Code

I tested this notebook and it answered incorrectly, either answered Melbourne or Italy, instead of Sesto, Italy. In the first case, when I got Melbourne, I set LLM to "gpt-3.5-turbo-0125" in cell:

from langchain_openai import ChatOpenAI
model = ChatOpenAI(temperature=0)
# model = ChatOpenAI(model="gpt-3.5-turbo-0125", temperature=0)

When I tested it with the default LLM ("gpt-3.5-turbo"), it answered Italy. Pls note planning result doesn't look the same as in the example at: https://github.com/langchain-ai/langgraph/blob/main/examples/rewoo/rewoo.ipynb it is this:

Plan: Use Google to search for the winner of the 2024 Australian Open. #E1 = Google[2024 Australian Open winner]
Plan: Use Google to search for the hometown of the 2024 Australian Open winner. #E2 = Google[hometown of 2024 Australian Open winner]

It is in the example:

Plan: Use Google to search for the 2024 Australian Open winner.
#E1 = Google[2024 Australian Open winner]

Plan: Retrieve the name of the 2024 Australian Open winner from the search results.
#E2 = LLM[What is the name of the 2024 Australian Open winner, given #E1]

Plan: Use Google to search for the hometown of the 2024 Australian Open winner.
#E3 = Google[hometown of 2024 Australian Open winner, given #E2]

Plan: Retrieve the hometown of the 2024 Australian Open winner from the search results.
#E4 = LLM[What is the hometown of the 2024 Australian Open winner, given #E3]

so I think a langchain/langgraph update might have caused this.

Error Message and Stack Trace (if applicable)

No response

Description

I tested this notebook and it answered incorrectly, either answered Melbourne or Italy, instead of Sesto, Italy, as of now, using default code and settings

System Info

System Information

OS: Windows OS Version: 10.0.19045 Python Version: 3.11.6 (tags/v3.11.6:8b6ee5b, Oct 2 2023, 14:57:12) [MSC v.1935 64 bit (AMD64)]

Package Information

langchain_core: 0.1.22 langchain: 0.1.7 langchain_community: 0.0.20 langsmith: 0.0.87 langchain_benchmarks: 0.0.2 langchain_cli: 0.0.21 langchain_experimental: 0.0.40 langchain_openai: 0.0.6 langchainhub: 0.1.13 langgraph: 0.0.24 langserve: 0.0.41