goose icon indicating copy to clipboard operation
goose copied to clipboard

Unable to use OpenRouter models when extensions are enabled

Open joepio opened this issue 11 months ago • 1 comments

Describe the bug When I try to use OpenRouter models, I get Request failed with status: 404 Not Found errors, but only if I enable extensions. If I disable these it works. For some reason the Jetbrains extensions doesn't have this problem.

To Reproduce

  1. Open Goose desktop
  2. Configure OpenRouter with an API key
  3. Select any model from OpenRouter (problem doesn't occur with Google or groq models)
  4. Turn on any extension (although, for some reason, the "Jetbrains" extension works fine?)
  5. Chat
  6. Get:Ran into this error: Request failed: Request failed with status: 404 Not Found. Please retry if you think this is a transient or recoverable error.
  7. Turn off all extensions
  8. Works fine!

Screenshots

Image Image

Please provide following information:

  • OS & Arch: MacOS latest m1
  • Interface: UI
  • Version: v1.0.5
  • Extensions enabled: If I disable them all, it works.
  • Provider & Model: Tried a bunch

joepio avatar Feb 14 '25 10:02 joepio

Same here but disabling extension still gives me same error with OpenRouter or local ollama.

Image

Elite avatar Feb 15 '25 03:02 Elite

@joepio can you list the model you used with openrouter?

@Elite can you provide the step to reproduce it? Also which version did you use?

Thanks

yingjiehe-xyz avatar Feb 18 '25 17:02 yingjiehe-xyz

1). Installed Goose v 1.0.7 2). Configured the OpenRouter and Ollama configurations.

Image

3). No matter if I choose the OpenRouter or Ollama options the same error is received.

Image

Elite avatar Feb 19 '25 02:02 Elite

@Elite can you make sure you have the right model name? By running ollama list?

yingjiehe-xyz avatar Feb 19 '25 04:02 yingjiehe-xyz

@Elite can you make sure you have the right model name? By running ollama list?

Irrespective of right/wrong model selection what gives the error on OpenRouter API ? Add to that all I am asked by goose is the OLLAMA_HOST value !!

UPDATE: I added the model listed by ollama list manually and it seemed to be accessing the host now. Not sure why OpenRouter give the error?

Update 2 : OK, so selecting the model google/gemini-2.0-pro-exp-02-05:free fixes the issue on OpenRouter.

Elite avatar Feb 19 '25 08:02 Elite

Hmm, I tried google/gemini-2.0-pro-exp-02-05:free on openrouter but it just doesn't reply anything:

Image

Other models (like mistralai/mistral-nemo:free and cognitivecomputations/dolphin3.0-r1-mistral-24b:free) failed.

The anthropic/claude-3.5-sonnet model at OpenRouter, however, does work.

I'll update OP

joepio avatar Feb 19 '25 10:02 joepio

@Elite can you make sure you have the right model name? By running ollama list?

Irrespective of right/wrong model selection what gives the error on OpenRouter API ? Add to that all I am asked by goose is the OLLAMA_HOST value !!

UPDATE: I added the model listed by ollama list manually and it seemed to be accessing the host now. Not sure why OpenRouter give the error?

Update 2 : OK, so selecting the model google/gemini-2.0-pro-exp-02-05:free fixes the issue on OpenRouter.

my bad, I thought you were using ollama, glad to hear selecting the right model fixes it

yingjiehe-xyz avatar Feb 19 '25 16:02 yingjiehe-xyz

@joepio can you restart the goose? Also can you check the openrouter activities page to see the raw metadata?

Thanks

yingjiehe-xyz avatar Feb 19 '25 16:02 yingjiehe-xyz

@joepio I verified the log, these models don't support tool use:

  2025-02-19T17:42:58.387534Z ERROR goose::agents::truncate: Error: Request failed: Object {"error": Object {"code": Number(404), "message": String("No endpoints found that support tool use. To learn more about provider routing, visit: https://openrouter.ai/docs/provider-routing")}}

I checked in the https://github.com/block/goose/pull/1293 to expose the error message

Close it now, if you have any other questions, feel free to reopen it

yingjiehe-xyz avatar Feb 19 '25 17:02 yingjiehe-xyz