Is there any example using local open source LLM model for evaluation?

[RyanTree-HS]

Using openAI api might not be feasible for some environment, could someone provide any reference or example link on running evaluation with local LLM model/?

[dosubot[bot]]

Yes, there are examples and documentation for evaluating RAG pipelines using local models in RAGAS. You can refer to the article by Atita Arora titled "Evaluating Retrieval Augmented Generation using RAGAS" for an end-to-end tutorial. Additionally, the RAGAS documentation includes a notebook titled "Evaluating RAG pipelines with Openlayer and Ragas," which provides a step-by-step guide for setting up and evaluating RAG pipelines with local models ^[1][2].

To continue talking to Dosu, mention @dosu.