mrm1001

Results 38 issues of mrm1001

**Goal**: Showcase the Haystack evaluation metrics on a dataset that is not a toy dataset (e.g. wikipedia articles) but that reflects use cases closer to what our users are working...

topic:eval
P1

**User story** I would like to learn how to apply Haystack core evaluations to improve my RAG pipeline, with an example on how to improve my retriever component, on an...

epic
topic:eval
P2

**Goal**: Showcase the Haystack evaluation metrics on an example that is close to what our users are trying to do, i.e. to improve a retriever in a RAG app. The...

topic:eval
P2

# Goal The goal is to refine this task into smaller sub-tasks which might include a review of existing approaches (with limitations), creating a proposal, implementing the solution. # User...

topic:agent

# Goal The goal is to refine this task into smaller sub-tasks which might include a review of existing approaches (with limitations), creating a proposal, implementing the solution. # User...

P2
topic:agent

# Context on benchmark work - goal number 1 is to give user **practical guidance** on what techniques to try out on their dataset/use case - goal number 2 is...

P1
topic:benchmark

# Goal The goal is to refine this task into smaller sub-tasks which might include a review of existing approaches (with limitations), creating a proposal, implementing the solution. # User...

topic:agent

# Goal The goal is to refine this task into smaller sub-tasks which might include a review of existing approaches (with limitations), creating a proposal, implementing the solution. # User...

topic:agent

# Goal The goal is to refine this task into smaller sub-tasks which might include a review of existing approaches (with limitations), creating a proposal, implementing the solution. # User...

topic:agent

Use evaluation on the selected datasets to optimise some parameters commonly tweaked in RAG pipelines: - top_k - chunk_size - embedding model The outcome should be a colab or notebook...

P1