How can I communicate with a local LLM model?

[Luckzq]

trafficstars

I want to use KoboldCpp or Ollama to provide translation services, believing that many LLM models can offer better results than existing online translation websites. What are the ways to achieve this?

https://github.com/KoboldAI/KoboldAI-Client https://github.com/ollama/ollama