jan icon indicating copy to clipboard operation
jan copied to clipboard

bug: Changing tools while conversing results in incorrect tool use

Open cab938 opened this issue 3 weeks ago • 0 comments

Version: 0.7.3

Describe the Bug

When you start a conversation in jan desktop with an assistant, the tools available to that assistant are populated based on your MCP configuration. It is possible to have multiple tools with the same name (e.g. Jan Browser MCP has a browser_navigate, and the popular playwright MCP also has a browser_navigate).

Steps to Reproduce

  1. Enable in Jan Desktop config both playwright mcp and jan browser mcp
  2. Start new conversation with agent
  3. Disable jan browser mcp tools and request a navigation to www.umich.edu
  4. Note that the navigation works correctly
  5. Disable playwright tools and enable jan browser mcp tools
  6. Open a new browser and navigate to https://menlo.ai/
  7. Share this tab through the jan browser extension tool
  8. Ask the agent questions about the tab (or ask it to navigate again) and note it continues to use the (supposedly now disabled) playwright mcp

Note: I did verifly that the jan browser mcp is working by explicitly asking the assistant to call bridge_status, which it did and confirmed we are connected. So the MCP tools are working, it's the direction from the conversation to the tool which isn't. My guess is that enabling or disabling tools either isn't refreshing the agent understanding of the tools (e.g. prepending or inserting a prompt updating knowledge, or changing the original system prompt for next messages), or the routing to the appropriate tool isn't working correctly.

Screenshots / Logs

Operating System

  • [ ] MacOS
  • [ ] Windows
  • [X] Linux

cab938 avatar Nov 13 '25 19:11 cab938