evals icon indicating copy to clipboard operation
evals copied to clipboard

Eval making guide?

Open Luka5-A8ram opened this issue 1 year ago • 2 comments

I am not proficiently in coding or using Github, but I would love to help making evals, sadly there is no coherent guide of how to.

Can someone please make an guide of how to make and post an eval?

Luka5-A8ram avatar Apr 12 '23 12:04 Luka5-A8ram

I understand the feeling. I felt a bit confused with the instructions at first but ended looking into the available examples and following the logic described in the notebooks.

lucianosb avatar Apr 12 '23 15:04 lucianosb

Yeah, I've found it quite challenging to navigate myself. I believe OpenAI would benefit from a more clear and beginner-friendly introduction that would allow a large influx of useful evals that are currently being bottlenecked by programming / github knowledge.

Hercules942 avatar Apr 22 '23 14:04 Hercules942