Sidebar ai chat issue

[rongxinyu]

When a follow up questions is asked in the chat side bar, I got internal server error.

The first question works, only follow up questions didn't.

This issue seems to have started since version 0.15. Previously I have no issue when I am on version 0.14.

I tried 0.15, 0.16 and 0.17 and they all have the same problem.

[mscolnick]

is there anything in your terminal? can you run marimo env? what AI provider are you using?

[rongxinyu]

I was using openai compatible provider, which is a proxy setup by my company. I tested both Claude and openai models.

Unfortunately I am not able to paste server logs from company computer here.

I tested Marimo 0.15, 0.16, 0.17 and they all have such issues. The error seems to suggest it has something to do with invalid sessions

[mscolnick]

what provider are you using? i saw someone post a similar issue with DeepSeek

[rongxinyu]

Through company proxy, I tried both Anthropic and OpenAI models and neither worked. I believe my company proxy simply route my request forward accordingly.

I am using custom models with OpenAI compatible btw

[mscolnick]

@rongxinyu can you reach out to your company IT whoever owns the proxy. it is possible it is using an outdated API that does not support multiple messages (im unsure)

[rongxinyu]

This was not an issue with marimo 0.14. Could you point me to what change in 0.15 that could have caused this? I would like to have a better sense such that my question to IT team will be more specific

[mscolnick]

@rongxinyu since 14, we started to pass tools to the API as well as content parts. These may be newer features of the API that your provider does not support.

[reachtarunhere]

@mscolnick how to handle a provider that does not support tools?

[mscolnick]

@reachtarunhere can you share an example provider?