ClassEval icon indicating copy to clipboard operation
ClassEval copied to clipboard

Do you plan to update the benchmark?

Open rodion-m opened this issue 9 months ago • 1 comments

This is a good benchmark, thank you for that. Do you plan to add modern models like Opus, llama-3, granite, codeqwen1.5-chat and so on to the benchmark?

rodion-m avatar May 09 '24 19:05 rodion-m

Thanks for your feedback! We are currently working on this and plan to add the latest models to the benchmark soon.

DXY-lemon avatar May 22 '24 07:05 DXY-lemon