haystack icon indicating copy to clipboard operation
haystack copied to clipboard

feat: LLM-based evaluators return meta info from OpenAI

Open davidsbatista opened this issue 1 week ago • 6 comments

Related Issues

Proposed Changes:

pass the meta entry from openai api to the result for all the LLM-based evaluators, containing the following fields:

  • model
  • prompt tokens
  • answer tokens
  • total tokens

How did you test it?

manual veritifcation + run local tests + end2endtests

Checklist

davidsbatista avatar Jun 28 '24 08:06 davidsbatista