tonic_validate icon indicating copy to clipboard operation
tonic_validate copied to clipboard
verified publisher icon TonicAI

Running local LLM with tonic_validate_evaluator

Open SalwaMostafa opened this issue 1 year ago • 0 comments

I want to run a local LLM loaded by LlamaCPP to be the evaluation model for tonic_validate_evaluator but the model_id or model_evaluator are taking string format only. How can I run local LLM as an evaluator model ?

SalwaMostafa avatar Jul 26 '24 06:07 SalwaMostafa