Kevin Tse

Your observation is correct. Currently, if a metric already exists (which is `"similar_to_expected"` in your case), it raises a warning (as seen in your notebook `"WARNING: similar_to_expected is already present,...

Hi @Sruthi5797, Can you post a minimal code snippet of what you are running? Also, are you seeing any warning message?

@rachittshah We can consider add LlamaIndex's eval if it integrates well with the pattern we have here. Feel free to propose something and we can have a look. @divij9 That...

I have updated the ask to be bite-size. Feel free to comment if anything is unclear!

@Divij97 Sure! Let us know if you plan to work on all 4 subtasks or a specific one. Feel free pick whichever you think you can contribute to. Thanks!