Renjun Hu comments

Repositories
Issues
Comments

Results 4 comments of


                                            Renjun Hu

Integrating third-party LLMs for Evaluating Chinese-native RAGs

Hi @jjmachan, we could offer two methods, following the existing practices of ragas, for integrating our models: 1. We have supported users in accessing our judge models via an API...

Integrating third-party LLMs for Evaluating Chinese-native RAGs

@jjmachan Hi, is there any feedback on the above proposal?

Integrating third-party LLMs for Evaluating Chinese-native RAGs

@landhu Thank you for your comment. That should work. And I am considering that ragas could maintain some third-party LLMs for evaluation and other purposes, like those on huggingface, in...

Integrating third-party LLMs for Evaluating Chinese-native RAGs

@jjmachan That's gonna be very helpful, especially for developers in regions without directyt access to openai models. Looking forward to the new feature.