openai-cookbook icon indicating copy to clipboard operation
openai-cookbook copied to clipboard

[PROBLEM] Typo in Getting_Started_with_OpenAI_Evals.ipynb

Open yangmarcyang opened this issue 9 months ago • 0 comments

[optional format]

Identify the file to be fixed examples/evaluation/Getting_Started_with_OpenAI_Evals.ipynb

Describe the problem According to the dataset format right above, and to be consistent with the example output of the synthetic data, it seems the role is supposed to be user instead of system in {"role": "system", "content": "Q: how many car makers are their in germany"}.

Describe a solution Change the role to user in {"role": "system", "content": "Q: how many car makers are their in germany"}

Feel free to close this issue if no fix is needed.

yangmarcyang avatar Jan 31 '25 21:01 yangmarcyang