evals icon indicating copy to clipboard operation
evals copied to clipboard

Add support for gpt-4o

Open androettop opened this issue 1 year ago • 3 comments

This is not a mr to add evals, it simply adds support for using gpt-4o #1529

androettop avatar May 16 '24 20:05 androettop

@andrew-openai @etr2460 @katyhshi bump on this PR, I was quite surprised to find out that OpenAI's own evals doesn't support their own latest model! If there's anything blocking this PR, might be worth relaying the reason for delays in merging? Thanks!

lucapericlp avatar Sep 11 '24 08:09 lucapericlp

Are you guys sunsetting evals? Any plans to support o1 as well?

sakher avatar Sep 15 '24 09:09 sakher

Following up on this topic, as I'm having the same issue with evaluating a fine-tuned gpt-4o-mini...

2025-04-16 19:50:40 - ERROR - main - Error Body Details: {'message': "Model 'ft:gpt-4o-mini-2024-07-18:<MASKED>' is not a valid model for your organization.", 'type': 'invalid_request_error', 'param': None, 'code': None}

arthurjan1994 avatar Apr 16 '25 17:04 arthurjan1994