athina-evals icon indicating copy to clipboard operation
athina-evals copied to clipboard

Feature/sdk run evals dataset

Open akshat-g opened this issue 2 months ago • 1 comments

Summary by CodeRabbit

  • New Features

    • Added methods to log dataset and batch results to Athina.
    • Introduced a new import statement for Dataset.
    • Added a function to remove keys with None values when creating datasets.
  • Refactor

    • Updated BaseEvaluator by removing eval_request_id assignment in run_batch.
    • Modified BatchRunResult class by removing eval_request_id attribute.
    • Added an abstract method load_athina_inferences in BaseLoader class.
  • Documentation

    • Added a function in dataset_helper.py to generate unique dataset names based on timestamps.

akshat-g avatar May 03 '24 17:05 akshat-g