uptrain icon indicating copy to clipboard operation
uptrain copied to clipboard

Published 20 hours ago • verified publisher icon uptrain-ai

Use Local LLM

Open philipchung opened this issue 2 months ago • 1 comments

I am interested in using Uptrain with a locally hosted open-source LLM as evaluator LLM. I'm currently hosting a LLM service using vLLM, not with Ollama. Is there any way to use this local LLM with Uptrain?

philipchung avatar Apr 26 '24 01:04 philipchung