AttributeError: 'float' object has no attribute 'replace'

[dihorial]

Hi! I need some help. I'm trying to run the system using the multihop-rag-summary dataset to evaluate LightRAG, but I've encountered the issue：

And here's my config2.yaml file

I'm not sure if this has any impact, but I have manually moved the nltk_data to the corresponding path.

[JayLZhou]

This is a bug about the nltk_data, I also often meet it. So just ignore it.

[dihorial]

Ok, thank you! What about the Attribute Error I mentioned at first, what should I do to solve it?

[JayLZhou]

Wait me a moment, we will try to fix it !

[sam234990]

The "multihop-rag-summary" dataset is designed for abstract questions. Currently, the existing code does not support evaluating abstract questions. We will integrate the evaluation code into our repo as soon as possible.

[dihorial]

I get it. So, those two datasets (multihop-rag & multihop-rag-summary) can't be evaluated with the current code, right? Does this apply to all GraphRAG models?

[JayLZhou]

Hi, we will release the evaluating code a.s.a.p