ragas

ragas copied to clipboard

how to control Ragas0.3.6 only generate simple test data

1

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** what is unclear to you? What would you like to know?...

z1quovadis-max

Adds automatic version branch syncing based on PR labels to streamline maintenance releases and backports. Automatically syncs merged PRs to appropriate version branches based on labels: Label mapping: - patch...

anistark

Hello Ragas community! 👋 Diego here from Red Hat's TrustyAI team. We built a Ragas Eval provider for Llama Stack. Would this be of interest to the Ragas community? **What...

dmaniloff

Break up judging prompts to take advantage of implicit caching

3

**Describe the Feature** Ragas prompts appear to repeat a lot of content on each invocation, namely in defining the task and providing the examples. The prompt is then amended with...

aachkar-samsara

Extremly high gpu memory consumption for evluation with custom LLM (over 60 GBs)

4

Hello, i created a testset and run it through my RAG pipeline to get documents and a answer for each question. I now have 50 pairs of [question, ground_truth, documents,...

Johncrtz

feat(metrics): Add Risk-Control Metric Suite

3

## Issue Link / Problem Description - Fixes #2279 - **Problem:** The `ragas` library currently excels at evaluating the quality of generated answers but lacks metrics to assess a RAG...

AlanPonnachan

How to use Amazon Bedrock as LLM/Embeddings after LangChain Wrappers are removed

4

[ x ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** In pull request #2253, LangChainLLMWrapper and LangchainEmbeddingsWrapper have been deprecated,...

licux

RAG using OLLAMA model evaluation with RAGAS

3

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. I am using RAGAS to evaluate my RAG pipeline with a local Ollama...

OlfaCh

feat: Addition of Risk-Control Metrics for Trustworthy RAG Evaluation

1

### Describe the Feature This proposal introduces a new, cohesive suite of four interconnected and academically-grounded metrics designed to evaluate a critical dimension currently missing from `ragas`: **a RAG system's...

AlanPonnachan

does it support deepseek

2

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** Does RAGAS support deepseek, if can, please add demo in doc.

landhu