kotaemon icon indicating copy to clipboard operation
kotaemon copied to clipboard

How to use Local LLM

Open scalenow opened this issue 1 year ago • 1 comments

Description

Sorry for the silly question .

Does Kotaemon has in built local LLM .I am not connected to any model yet document analysis is working .

How do I connect to my local LLM .i see option only for online model

Reproduction steps

1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error
na

Screenshots

![DESCRIPTION](LINK.png)
na

Logs

na

Browsers

Chrome

OS

Linux

Additional information

na

scalenow avatar Nov 13 '24 08:11 scalenow

Hi @scalenow please check this guide for local model integration with Ollama or HF https://github.com/Cinnamon/kotaemon/blob/main/docs/local_model.md

taprosoft avatar Nov 15 '24 03:11 taprosoft

Thanks @taprosoft

scalenow avatar Jan 16 '25 13:01 scalenow