evals
evals copied to clipboard
Add support for gpt-4o
This is not a mr to add evals, it simply adds support for using gpt-4o #1529
@andrew-openai @etr2460 @katyhshi bump on this PR, I was quite surprised to find out that OpenAI's own evals doesn't support their own latest model! If there's anything blocking this PR, might be worth relaying the reason for delays in merging? Thanks!
Are you guys sunsetting evals? Any plans to support o1 as well?
Following up on this topic, as I'm having the same issue with evaluating a fine-tuned gpt-4o-mini...
2025-04-16 19:50:40 - ERROR - main - Error Body Details: {'message': "Model 'ft:gpt-4o-mini-2024-07-18:<MASKED>' is not a valid model for your organization.", 'type': 'invalid_request_error', 'param': None, 'code': None}