awesome-llm-apps icon indicating copy to clipboard operation
awesome-llm-apps copied to clipboard

Issue in running llama3_local_rag

Open sathiya-mit opened this issue 9 months ago • 2 comments

Getting below error.

ValueError: Error raised by inference endpoint: HTTPConnectionPool(host='localhost', port=11434): Max retries exceeded with url: /api/embeddings (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x124e0a310>: Failed to establish a new connection: [Errno 61] Connection refused'))

sathiya-mit avatar May 05 '24 09:05 sathiya-mit

Hi, You must first install ollama in your computer (it will act as a server).

gth-ai avatar May 05 '24 14:05 gth-ai

I think the above comment would solve your problem @sathiya-mit.

Thanks @gth-ai for jumping in and supporting the community.

Shubhamsaboo avatar May 05 '24 18:05 Shubhamsaboo