gateway icon indicating copy to clipboard operation
gateway copied to clipboard

[Feature] remove temperature param in case of reasoning models like o1 and o3

Open carlosveloso opened this issue 9 months ago • 2 comments

What Would You Like to See with the Gateway?

Some libraries like Vercel AI send a default temperature: 0 value, that breaks the calls to reasoning models of OpenAI, currently there is no way of remove that. Is posible to ignore it or remove that param in the gateway?

Context for your Request

No response

Your Twitter/LinkedIn

No response

carlosveloso avatar Feb 03 '25 04:02 carlosveloso

hey @carlosveloso the gateway does not transform the requests sent to openai as the gateway is supposed to be openai compliant. I mean we could remove the param for specific models, but I don't think it's a great idea ig

narengogi avatar Feb 04 '25 12:02 narengogi

we'll support deleting keys using the x-portkey-config header

narengogi avatar Mar 21 '25 10:03 narengogi

closing as stale + not planned

narengogi avatar Jul 09 '25 07:07 narengogi