division by zero when computing output score

[theoden8]

Good time of the day,

Here https://github.com/explodinggradients/ragas/blob/main/src/ragas/testset/filters.py#L60 is a division by zero, which I encounter when using ragas with ollama+llama3-8b.

To solve it, I can replace:

output["score"] = sum(output.values()) / len(output.values())

Keeps failing at the final stage. Can be fixed with

if len(output.values()) == 0:
    output['score'] = .0
else:
    output["score"] = sum(output.values()) / len(output.values())

[eugene-iacovciuc]

Hello! I'm facing the same issue. Any updates on this so far?

[Ahmed-Ghazouani]

any update ?

[anistark]

Closing this as resolved.

Use TestsetGenerator in the new version.