openai-cookbook
                                
                                
                                
                                    openai-cookbook copied to clipboard
                            
                            
                            
                        [PROBLEM] Typo in Getting_Started_with_OpenAI_Evals.ipynb
[optional format]
Identify the file to be fixed examples/evaluation/Getting_Started_with_OpenAI_Evals.ipynb
Describe the problem
According to the dataset format right above, and to be consistent with the example output of the synthetic data, it seems the role is supposed to be user instead of system in {"role": "system", "content": "Q: how many car makers are their in germany"}.
Describe a solution
Change the role to user in {"role": "system", "content": "Q: how many car makers are their in germany"}
Feel free to close this issue if no fix is needed.