ragas icon indicating copy to clipboard operation
ragas copied to clipboard

Traditional NLP Metrics examples in docs are broken

Open dschuler36 opened this issue 1 year ago • 1 comments

[X] I have checked the documentation and related resources and couldn't resolve my bug.

Describe the bug The examples from the 'Traditional NLP Metrics' don't work on the current version.

Ragas version: 0.1.21 Python version: 3.11.10

Code to Reproduce

from ragas.dataset_schema import SingleTurnSample

or

from ragas.metrics._bleu_score import BleuScore

Error trace

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ModuleNotFoundError: No module named 'ragas.dataset_schema'

and

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ModuleNotFoundError: No module named 'ragas.metrics._bleu_score'

Expected behavior Modules are imported successfully

Additional context This works on ragas==0.1.18

dschuler36 avatar Oct 10 '24 18:10 dschuler36

Hey @dschuler36! I'm here to help you with any bugs, questions, or contributions. Let's tackle this issue together!

The issue you're encountering with the 'Traditional NLP Metrics' examples in Ragas version 0.1.21 is due to missing modules ragas.dataset_schema and ragas.metrics._bleu_score. This problem arises because these modules or classes might have been removed or renamed in the latest version.

To resolve this, check the latest documentation or release notes for any changes in module structure or class names. You might need to adjust your imports based on the updated module paths or use an earlier version like ragas==0.1.18 where these imports work as expected [1].

To continue talking to Dosu, mention @dosu.

dosubot[bot] avatar Oct 10 '24 19:10 dosubot[bot]