ragas

ragas copied to clipboard

I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** Do RAGAS prompts work equally well with other LLMs like Claude 3 Sonnet...

yadavshashank

[R-258] Question about official docs of Context Precision.

3

What I understood is that Following case is calculation of Context Precision at K=2. For that case, Last part's denominator must be 2 not 1. Is this right? If i...

JongoPark-complex625

[R-257] [Feature Request] Llamaindex support

9

the title says it all but this is for ragas v0.1 😉 [R-257](https://linear.app/exploding-gradients/issue/R-257/[feature-request]-llamaindex-support)

jjmachan

[R-235] Testset generation. ValueError: a cannot be empty unless no samples are taken - Not use adaptor

16

Testing it with a single small document splitter in 5 chuncks. Repeating the test with 2 documents. To see if that could be the issue. This could be related to...

JPonsa

In issue #963 I commented about the RuntimeError when trying to use TestsetGenerator. In issue #681 you discussed that using get_event_loop() was the optimal way to solve the issue but...

abetatos

[R-242] trouble in importing pydantic_output_parser from langchain

9

**Describe the bug** Once ragas is installed I want to import it and I got an error on the import of pydantic output parser from langchain. Ragas version: 0.1.6 Python...

kluskaj

Task was destroyed but it is pending!

13

**Describe the bug** I use ragas to evaluate my project,the dataset comes from the project, when I use 100 number of data,it is normal and could get the evaluate result.Then...

pxiongw

Add better testset using the testset generation features of 2 dataset 1. Githlab Handbook 2. Arxiv Papers on LLMs Need to figure out the number of testsets needed From [SyncLinear.com](https://synclinear.com)...

jjmachan

fix(testset): Ensure each document is used only once for question gen…

7

…eration Previously, the code used a nested loop to iterate over the distributions and generate questions for each document. However, this approach had a potential issue where a single document...

princepride

Tried Generation Test Set from Together APIs and Hugging Face Embeddings

2

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** Tried Generation Test Set from Together APIs and Hugging Face Embeddings Ragas...

Eknathabhiram