mindcraft icon indicating copy to clipboard operation
mindcraft copied to clipboard

Using other Ollama LLMs

Open Savin1play140 opened this issue 10 months ago • 9 comments

I would like to see the ability to use other LLMs besides llama3 and support for hosts other than localhost when using Ollama added

Savin1play140 avatar Feb 04 '25 18:02 Savin1play140

I'm using Deepseek from a host running ollama

Rolzzz avatar Feb 07 '25 05:02 Rolzzz

I'm using Deepseek from a host running ollama

How did you do that it does not work for me

freerangesubject82 avatar Feb 13 '25 11:02 freerangesubject82

I'm using Deepseek from a host running ollama

How did you do that it does not work for me

Tell me more about your circumstances?

Savin1play140 avatar Feb 13 '25 11:02 Savin1play140

The issue I see is that the <think> tags get included.

shinjitumala avatar Feb 13 '25 12:02 shinjitumala

I'm using Deepseek from a host running ollama

How did you do that it does not work for me

jump onto the discord for some help... but from my testing deepseek is crap for this bot.

Rolzzz avatar Feb 13 '25 20:02 Rolzzz

The issue I see is that the <think> tags get included.

This is fine R1 deepseek models are trained and created so that the output shows its thinking

Savin1play140 avatar Feb 14 '25 06:02 Savin1play140

The issue I see is that the <think> tags get included.

This is fine R1 deepseek models are trained and created so that the output shows its thinking

but that causes it to execute commands its not supposed to

uukelele-scratch avatar Mar 01 '25 08:03 uukelele-scratch

Проблема, которую я вижу, заключается в том, что <think>теги включены.

Это нормально. Модели R1 deepseek обучаются и создаются таким образом, чтобы вывод отображал ход их мыслей.

но это заставляет его выполнять команды, которые он не должен выполнять

in this case I recommend using regular models of the type deepseek-V3

Savin1play140 avatar Mar 01 '25 08:03 Savin1play140

Pull request #423 fixes this exact issue

Sweaterdog avatar Mar 01 '25 08:03 Sweaterdog

#423 has been merged.

uukelele-scratch avatar Sep 23 '25 08:09 uukelele-scratch