ragas

ragas copied to clipboard

Answer Correctness not working after pydantic update

1

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** A clear and concise description of what the bug is. Ragas version:...

hubkrieb

How to integrate Ragas with Ragflow for evaluation?

1

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. How to integrate Ragas with Ragflow for evaluation? Is there any documentation I...

RyanTree-HS

answer_relevancy score decreased drasctically

3

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** The code is identical only difference is the packages version ex)...

jinnoh47

Docs page is not found

3

https://docs.ragas.io/en/latest/howtos/applications/compare_embeddings.html shows 404

rodion-m

Error: xception raised in Job[0]: APIConnectionError(Connection error.) when split one big batch into several small batches to submit

9

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** I set up a defination to split the input Dataset into several...

francescofan

Get an error 'Invalid n value (currently only n = 1 is supported)' when calculating the score of metric named 'answer_relevancy'

6

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** Error message is "Invalid n value (currently only n = 1 is...

francescofan

Test dataset Issue

1

WARNING:ragas.testset.docstore:Filename and doc_id are the same for all nodes. --------------------------------------------------------------------------- ValueError Traceback (most recent call last) [](https://localhost:8080/#) in () 9 10 # generate testset ---> 11 testset1 = generator.generate_with_langchain_docs(documents, test_size=10,...

nandhu-nr

Can't generate testdataset, always connection error and event loops is closed.

20

[x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** LLM is started by ollama, so there's no connection issue and it is...

KylinMountain

I can't generate Test Data.

1

----> 1 testset = generator.generate_with_langchain_docs(documents, test_size=10, distributions={simple: 0.5, reasoning: 0.25, multi_context: 0.25},raise_exceptions=False) 2 frames /usr/local/lib/python3.10/dist-packages/ragas/testset/docstore.py in add_nodes(self, nodes, show_progress) 251 results = executor.results() 252 if not results: --> 253 raise...

nandhu-nr

embedding factory

3

I checked the evaluate function and deep inside there is a function called 'embedding_factory'. by default it use openai I put the whole function here. def embedding_factory( model: str =...

amin-kh96