openai-python icon indicating copy to clipboard operation
openai-python copied to clipboard

Error regarding knowledge cutoff

Open 2010person opened this issue 2 years ago • 0 comments

Describe the bug

In the system message to GPT-3.5-turbo, I have set the knowledge cutoff to the 27/3/22 (so it knows all the events that have happened today). But, when I ask it who the current PM is, it says Boris Johnson instead of Rishi Sunak. I have put images in the code snippets below. Am I doing anything wrong?

To Reproduce

  1. Use GPT-3.5-turbo
  2. Set the knowledge cutoff date to 27/3/23
  3. Ask it who the British PM is.

Code snippets

Code (user is a variable):
messages=[
        {"role": "system", "content": "You are ChatGPT, a large language model trained by OpenAI. Answer as concisely as possible. Knowledge cutoff: {27/3/23} Current date: {26/3/23}"},
        {"role": "user", "content": user},
        {"role": "assistant", "content": "Hi user, your question delights me the answer is:"},
    ]
Output: 
As of my knowledge cutoff date of March 27, 2023, Boris Johnson is still serving as Prime Minister of the United Kingdom, so there hasn't been a Prime Minister after him yet.

OS

Windows 11

Python version

Python v3.10.4

Library version

openai-python v0.27.2

2010person avatar Mar 26 '23 10:03 2010person