ollama-telegram
ollama-telegram copied to clipboard
llama3
trying to use it with llama3 but it does not reply to my messages
Any ideea how to debut this?
Also when I try to run it from docker (although there is an .env file with the api key for telegram)
Thank you.
It worked eventually with llama3, but I left llama-2 in .env file. maybe here a try catch would be useful:
The error you're getting in the message is already the result of a try-catch: https://github.com/ruecat/ollama-telegram/blob/279fac5cc47ead788c03366a47993ab1f3c82bab/bot/run.py#L256-L261
The model response is streamed to the user and chunks are constructed into the message response -- you likely received a complete response, in addition to the error message, which was caught on a single chunk.
If you don't want to see error messages in the telegram chat, you should be able to replace lines 257-261 with a log or print statement (anything other than a message) and restart your container
next step for this would be RAG support via telegram :)