haystack icon indicating copy to clipboard operation
haystack copied to clipboard

Download experiment results from DC

Open FHardow opened this issue 2 years ago • 2 comments

Is your feature request related to a problem? Please describe. Thanks to @tstadel the deepset cloud sdk holds functionality to create and start an experiment run. We are currently missing the functionality to download the results as dataframe or as csv file. This ticket aims to add these two things as extra function to the DeepsetCloudExperiments class.

~- [x] function to download the csv file~ will be done by the functionality below

  • [x] function to download the predictions ~per node~, should return ~a pandas dataframe~ a EvaluationResult object
  • [x] tests

Describe the solution you'd like Add a function to fetch predictions and the experiment result dataframe from deepset cloud.

Additional context API endpoint definitions can be found here.

FHardow avatar Jul 29 '22 11:07 FHardow

@FHardow the second checked point should result in a proper EvaluationResult object being returned. This is just a container around the dataframes with additional functionality like calculate_metrics, etc.

tstadel avatar Aug 01 '22 15:08 tstadel

Okay will change it in the description, thanks for the comment :)

FHardow avatar Aug 02 '22 13:08 FHardow

Completed with https://github.com/deepset-ai/haystack/pull/2960

FHardow avatar Aug 10 '22 13:08 FHardow