gateway
gateway copied to clipboard
[Feature] Return model in response when provider does not
trafficstars
What Would You Like to See with the Gateway?
Some of the providers like bedrock do not return the model in the response json when invoking endpoints like completions and chat completions
This wouldn't generally be an issue because users can just infer model from the request that they've sent, but in some cases people might be using stored configs and then returning model in response becomes necessary
Context for your Request
these are all the providers that are returning model as an empty string
- ai21
- anthropic
- bedrock
- cohere
- vertex anthropic
- novita, ollama, openrouter, together-ai, workers-ai
Your Twitter/LinkedIn
No response