goose KAT-DEV33B Q8 Jan.ai Goose not working

Tried to use Devstral Q8 working with goose,

Jan.ai v0.72, goose latest v1.12.1

Tried to use Mungert KAT-DEV Q8 with goose nor working. (works in chat mode in Jan.ai)

Ran into this error: Server error: Some(Object {"error": Object {"code": Number(500), "message": String("Value is not callable: null at row 59, column 114:\n {%- for json_key in param_fields.keys() if json_key not in handled_keys %}\n {%- set normed_json_key = json_key | replace("-", "") | replace(" ", "") | replace("$", "") %}\n ^\n {%- if param_fields[json_key] is none %}\n at row 59, column 21:\n {%- for json_key in param_fields.keys() if json_key not in handled_keys %}\n {%- set normed_json_key = json_key | replace("-", "") | replace(" ", "") | replace("$", "") %}\n ^\n {%- if param_fields[json_key] is none %}\n at row 58, column 91:\n {%- set handled_keys = ['type', 'description', 'enum', 'required'] %}\n {%- for json_key in param_fields.keys() if json_key not in handled_keys %}\n ^\n {%- set normed_json_key = json_key | replace("-", "") | replace(" ", "") | replace("$", "") %}\n at row 58, column 17:\n {%- set handled_keys = ['type', 'description', 'enum', 'required'] %}\n {%- for json_key in param_fields.keys() if json_key not in handled_keys %}\n ^\n {%- set normed_json_key = json_key | replace("-", "") | replace(" ", "") | replace("$", "") %}\n at row 47, column 84:\n {% if tool.parameters.properties is defined %}\n {%- for param_name, param_fields in tool.parameters.properties|items %}\n ^\n {{- '\n' }}\n at row 47, column 13:\n {% if tool.parameters.properties is defined %}\n {%- for param_name, param_fields in tool.parameters.properties|items %}\n ^\n {{- '\n' }}\n at row 46, column 55:\n {{- '\n' }}\n {% if tool.parameters.properties is defined %}\n ^\n {%- for param_name, param_fields in tool.parameters.properties|items %}\n at row 46, column 9:\n {{- '\n' }}\n {% if tool.parameters.properties is defined %}\n ^\n {%- for param_name, param_fields in tool.parameters.properties|items %}\n at row 39, column 29:\n {{- "" }}\n {%- for tool in tools %}\n ^\n {%- if tool.function is defined %}\n at row 39, column 5:\n {{- "" }}\n {%- for tool in tools %}\n ^\n {%- if tool.function is defined %}\n at row 36, column 51:\n{%- endif %}\n{%- if tools is iterable and tools | length > 0 %}\n ^\n {{- "\n\nYou have access to the following functions:\n\n" }}\n at row 36, column 1:\n{%- endif %}\n{%- if tools is iterable and tools | length > 0 %}\n^\n {{- "\n\nYou have access to the following functions:\n\n" }}\n at row 1, column 1:\n{% macro render_item_list(item_list, tag_name='required') %}\n^\n {%- if item_list is defined and item_list is iterable and item_list | length > 0 %}\n"), "type": String("server_error")}}).

Please retry if you think this is a transient or recoverable error.

Any idea?

[16:09:14] INFO Jan API server stopped [16:09:16] INFO Jan API server started on http://127.0.0.1:1337 [16:09:27] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:09:27] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:09:27] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:09:27] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:09:27] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:09:27] DEBUG Adding session Authorization header [16:09:27] DEBUG Adding session Authorization header [16:09:27] DEBUG Sending buffered body (613 bytes) [16:09:27] DEBUG Sending buffered body (45757 bytes) [16:09:27] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:09:27] DEBUG Received response with status: 500 Internal Server Error [16:09:27] DEBUG Streaming complete to client [16:09:28] DEBUG Received response with status: 200 OK [16:09:28] DEBUG Streaming complete to client [16:11:36] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:11:36] DEBUG Extracted model_id: Devstral-Small-2507 [16:11:36] DEBUG Found session for model_id Devstral-Small-2507 [16:11:36] DEBUG Adding session Authorization header [16:11:36] DEBUG Sending buffered body (49625 bytes) [16:11:36] DEBUG Received response with status: 200 OK [16:11:47] DEBUG Streaming complete to client

Oct 31 '25 16:10 akierum

deleted template I used in the model config in Jan.ai not it started to work but after I while server crashes and inference stops.

[16:18:00] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:18:00] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:18:00] DEBUG Adding session Authorization header [16:18:00] DEBUG Sending buffered body (50961 bytes) [16:18:01] DEBUG Received response with status: 200 OK [16:18:06] DEBUG Client disconnected during streaming [16:18:06] DEBUG Streaming complete to client [16:18:44] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:18:44] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:18:44] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:18:44] DEBUG Adding session Authorization header [16:18:44] DEBUG Sending buffered body (37920 bytes) [16:18:44] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:18:44] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:18:44] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:18:44] DEBUG Adding session Authorization header [16:18:44] DEBUG Sending buffered body (500 bytes) [16:18:44] DEBUG Received response with status: 200 OK [16:18:47] DEBUG Received response with status: 200 OK [16:18:47] DEBUG Streaming complete to client [16:18:51] DEBUG Streaming complete to client [16:18:53] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:18:53] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:18:53] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:18:53] DEBUG Adding session Authorization header [16:18:53] DEBUG Sending buffered body (38524 bytes) [16:18:53] DEBUG Received response with status: 200 OK [16:18:55] DEBUG Streaming complete to client [16:18:56] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:18:56] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:18:56] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:18:56] DEBUG Adding session Authorization header [16:18:56] DEBUG Sending buffered body (38883 bytes) [16:18:56] DEBUG Received response with status: 200 OK [16:18:58] DEBUG Streaming complete to client [16:18:59] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:18:59] DEBUG Adding session Authorization header [16:18:59] DEBUG Sending buffered body (39932 bytes) [16:18:59] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:18:59] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:18:59] DEBUG Received response with status: 200 OK [16:19:03] DEBUG Streaming complete to client [16:19:04] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:19:04] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:19:04] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:19:04] DEBUG Adding session Authorization header [16:19:04] DEBUG Sending buffered body (41085 bytes) [16:19:04] DEBUG Received response with status: 200 OK [16:19:11] DEBUG Streaming complete to client [16:19:11] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:19:11] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:19:11] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:19:11] DEBUG Adding session Authorization header [16:19:11] DEBUG Sending buffered body (72629 bytes) [16:19:12] DEBUG Received response with status: 200 OK [16:19:26] DEBUG Streaming complete to client [16:19:27] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:19:27] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:19:27] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:19:27] DEBUG Sending buffered body (79209 bytes) [16:19:27] DEBUG Adding session Authorization header [16:19:27] DEBUG Received response with status: 200 OK [16:20:02] ERROR Stream error: request or response body error: error reading a body from connection: An existing connection was forcibly closed by the remote host. (os error 10054) [16:20:02] DEBUG Streaming complete to client [16:20:02] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:20:02] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:20:02] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:20:02] DEBUG Adding session Authorization header [16:20:02] DEBUG Sending buffered body (79865 bytes) [16:20:04] ERROR Proxy request to model failed: error sending request for url (http://127.0.0.1:3872/chat/completions): error trying to connect: tcp connect error: No connection could be made because the target machine actively refused it. (os error 10061)

Oct 31 '25 16:10 akierum

Restarted server in Jan.ai but not longer working, log:

[16:23:12] INFO Jan API server stopped [16:23:13] INFO Jan API server started on http://127.0.0.1:1337 [16:23:35] DEBUG Handling POST request to /chat/completions requiring model lookup in body [16:23:35] DEBUG Extracted model_id: Mungert-KAT-Dev-q8_0 [16:23:35] DEBUG Found session for model_id Mungert-KAT-Dev-q8_0 [16:23:35] DEBUG Adding session Authorization header [16:23:35] DEBUG Sending buffered body (80052 bytes) [16:23:37] ERROR Proxy request to model failed: error sending request for url (http://127.0.0.1:3872/chat/completions): error trying to connect: tcp connect error: No connection could be made because the target machine actively refused it. (os error 10061)

Oct 31 '25 16:10 akierum

Your Jan API server is running fine on http://127.0.0.1:1337, but when it tries to forward a chat request to the model backend (Mungert-KAT-Dev-q8_0), it fails with:

error trying to connect: tcp connect error: No connection could be made because the target machine actively refused it. (os error 10061)

That means Jan tried to connect to another local service (on port 3872), but nothing was listening there — the model backend process isn’t running or isn’t reachable.

How port changes to 3872 mid inference from 1337 ? How / why Goose want to use 3872?

Oct 31 '25 16:10 akierum

After using mungert qwen3 coder template that fixed also basedbase qwen3 coder and official qwen3 coder in KAT-DEV33B Q8 it no longer gives error, in first post and starts to work, but tool calls are still in chat, and model hangs after a while endless processing without errors.

mungert template here https://github.com/block/goose/issues/5244

This is tools calls in chat: (seems template problem no answer from KAT-DEV33b model devs.)

(no content)

<tool_call> <function=developer__text_editor

Nov 01 '25 04:11 akierum

thanks for diving into this @akierum - is there anything you need from us?

Nov 04 '25 22:11 DOsinga

closing this for now

Nov 06 '25 13:11 DOsinga