landhu

In python3, test packages can not find testcase

1

Like this: testcase |---- __init__.py |---- test_bb.py test_bb.py file is: def test_qq(): pass In python 3.8: nosetests testcase: Ran 0 tests in xxx OK In python 2: this ok ,can...

[Question] How to change custom mode name

4

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. ** How do I specify the name of the model** An LLM is...

How can I ignore specific symbol when evaluate answer_correctness

2

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** My dataset here: {'question': 'what are you going', 'answer': "I'm going...

can customize CORRECTNESS_INSTRUCTIONS and CORRECTNESS_PROMPT when evaluate answer_correctnes

3

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** can customize CORRECTNESS_INSTRUCTIONS and CORRECTNESS_PROMPT when evaluate answer_correctnes **Code Examples** I...

[Question]How to integrate with pytest

2

From sample, I did't find any demo about how to intergrate with pytest. I want like following: 1. setup: setup Broswer() and a agent about open a url 2. testcase1:...

why await no support from demo

2

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** run demo in https://docs.ragas.io/en/latest/getstarted/evals/#evaluating-using-a-llm-based-metric Ragas version: Python version: 3.10 Ragas Version: ragas...

How to evaluate rags in other language

3

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** How to evaluate rags in other language. 1. The dataset has...

my web page is large. when I use const headerText = await auto("get the header text", { page, test }); shows: "This model's maximum context length is 128000 tokens. However,...

does it support deepseek

2

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** Does RAGAS support deepseek, if can, please add demo in doc.