gateway icon indicating copy to clipboard operation
gateway copied to clipboard

[Feature] Return model in response when provider does not

Open narengogi opened this issue 8 months ago • 0 comments
trafficstars

What Would You Like to See with the Gateway?

Some of the providers like bedrock do not return the model in the response json when invoking endpoints like completions and chat completions

This wouldn't generally be an issue because users can just infer model from the request that they've sent, but in some cases people might be using stored configs and then returning model in response becomes necessary

Context for your Request

these are all the providers that are returning model as an empty string

  • ai21
  • anthropic
  • bedrock
  • cohere
  • vertex anthropic
  • novita, ollama, openrouter, together-ai, workers-ai

Your Twitter/LinkedIn

No response

narengogi avatar Mar 11 '25 07:03 narengogi