anything-llm icon indicating copy to clipboard operation
anything-llm copied to clipboard
Published 6 days ago • verified publisher icon Mintplex-Labs

[BUG]: AOAI GPT-5 models cannot use tools

Open vlad-tsoy opened this issue 1 month ago • 2 comments

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

Same issue as #4385, but for the Azure OpenAI endpoint.

Are there known steps to reproduce?

  1. Set up the AOAI endpoint with a reasoning model
  2. Send a message to the agent with a tool call: @agent Collect the text of this page: https://docs.anythingllm.com/installation-desktop/debug

vlad-tsoy avatar Nov 12 '25 15:11 vlad-tsoy

What happens after you send the message? Any error messages? Logs? Feel free to share a screenshot or screen recording.

angelplusultra avatar Nov 12 '25 19:11 angelplusultra

Sorry, I wasn't very clear earlier. I'm using AnythingLLM Desktop on an M3 Mac. Here is the screenshot of the error. I do not see any errors in the event log.

Image

vlad-tsoy avatar Nov 12 '25 19:11 vlad-tsoy

Image

I am using gpt-5-chat deployment and cannot reproduce this. What specific model are you using? I just deployed this on Azure portal

Image

timothycarambat avatar Nov 21 '25 02:11 timothycarambat

Hi @timothycarambat, thank you for looking into this. I was able to use the GPT-5 chat model; however, when I try using GPT-5, GPT-5.1, or GPT-5.1-chat, I'm seeing this error. If you pick any reasoning model from AOAI, this error occurs.

vlad-tsoy avatar Nov 21 '25 15:11 vlad-tsoy