prompttools icon indicating copy to clipboard operation
prompttools copied to clipboard

Published 20 hours ago • verified publisher icon hegelai

Add support for other models in AutoEval

Open Divij97 opened this issue 1 year ago • 1 comments

This PR targets targets this feature request

Divij97 avatar Aug 04 '23 19:08 Divij97

Hey @Divij97 this looks great! Very elegant way to support Anthropic + OpenAI as evaluators. I'm guessing Claude and GPT will need different eval prompts, but this is definitely headed in the right direction. Let me know when this is ready for a full review

steventkrawczyk avatar Aug 04 '23 19:08 steventkrawczyk