ollama-telegram icon indicating copy to clipboard operation
ollama-telegram copied to clipboard

llama3

Open gabyavra opened this issue 10 months ago • 3 comments

trying to use it with llama3 but it does not reply to my messages

image Screenshot 2024-04-21 at 18 13 27

Any ideea how to debut this?

Also when I try to run it from docker (although there is an .env file with the api key for telegram)

image

Thank you.

gabyavra avatar Apr 21 '24 15:04 gabyavra

It worked eventually with llama3, but I left llama-2 in .env file. maybe here a try catch would be useful:

IMG_4250 IMG_4251 IMG_4252

gabyavra avatar Apr 21 '24 16:04 gabyavra

The error you're getting in the message is already the result of a try-catch: https://github.com/ruecat/ollama-telegram/blob/279fac5cc47ead788c03366a47993ab1f3c82bab/bot/run.py#L256-L261

The model response is streamed to the user and chunks are constructed into the message response -- you likely received a complete response, in addition to the error message, which was caught on a single chunk.

If you don't want to see error messages in the telegram chat, you should be able to replace lines 257-261 with a log or print statement (anything other than a message) and restart your container

lnrssll avatar Apr 30 '24 15:04 lnrssll

next step for this would be RAG support via telegram :)

gabyavra avatar Apr 30 '24 16:04 gabyavra