ragas

ragas copied to clipboard

Fixed the issue of changing to Unicode characters in the json.dumps

2

When using json.dumps, if the character is not an ASCII character, it is converted to a Unicode character and output or passed to LLM. Due to this issue, LLM is...

Youngrok123

Synthetic test data generation failed for huggingface models

2

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** I am trying to generate test data for ragas evaluation, I have...

wanjeakshay

#### Description This pull request addresses an issue related to the use of the `json.dumps` and `json.dump` methods in the prompt construction process. Currently, the `ensure_ascii` parameter is not set,...

dlutwy

Ragas evaluation

27

Faithfulness is not callable

Senthselvi

How can i set config parameters for test data generation

6

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** How can i set config parameters for test data generation for...

wanjeakshay

How does RAGAS generate ground_truth in TestSetGenerator class

23

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** How does RAGAS generate ground_truth in TestSetGenerator class

adityamity

Context Precision Metric Binary values

1

I have noticed that if you look at the evaluated data set, the metric is determined individually for each data point of the dataset. The output of the console is...

kaan9700

Significance of docstore in TestsetGenerator.

9

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** What is the use of docstore in TestsetGenerator. How it will...

adityamity

ValidationError: 1 validation error for Prompt

1

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** When I try to use generator.adapt(language='chinese'), I still encounter errors related to...

beatG123

Test data generation for function calling

1

Hey, I was wondering if you think it would be possible to create a synthetic dataset for function calling tasks? I would like to use that dataset for a finetuning...

alexHeu