haystack icon indicating copy to clipboard operation
haystack copied to clipboard

Implement evaluation and metrics calculation

Open silvanocerza opened this issue 2 years ago • 1 comments

As outlined in proposal #5794 we need to implement evaluation and metrics calculation for Haystack 2.x.

To complete this epic we need to close the following issues:

### Tasks
- [ ] #6056
- [ ] #6057
- [ ] #6058
- [ ] #6059
- [ ] #6060
- [ ] https://github.com/deepset-ai/haystack/issues/6063
- [ ] https://github.com/deepset-ai/haystack/issues/6062
- [ ] https://github.com/deepset-ai/haystack/issues/6064
- [ ] https://github.com/deepset-ai/haystack/issues/6065
- [ ] https://github.com/deepset-ai/haystack/issues/6066
- [ ] https://github.com/deepset-ai/haystack/issues/6067
- [ ] https://github.com/deepset-ai/haystack/issues/6068
- [ ] https://github.com/deepset-ai/haystack/issues/6069

silvanocerza avatar Oct 16 '23 06:10 silvanocerza

@silvanocerza I have opened a draft PR (#6464) that adds Evaluation and Metrics calculation for components and Pipelines. Requesting comments on the overall approach. Thanks.

awinml avatar Dec 01 '23 05:12 awinml