haystack-tutorials icon indicating copy to clipboard operation
haystack-tutorials copied to clipboard

Add Evaluation tutorials for other Nodes

Open Timoeller opened this issue 3 years ago • 0 comments

We have Tutorial 5 on Evaluation, working with QA and passage search eval.

The pipeline.eval is structured to work with other nodes as well, but it would be good to have examples that people can base their work on, e.g. for generative QA or tableQA.

Other methods like FAQ matching, query + doc classifiers, summarization and translation need different labels (I think). We should create dedicated tutorials for those. FAQ matching would be a good next candidate.

Timoeller avatar Dec 06 '21 17:12 Timoeller