Overriding model with extra_params/extra_body not working?

[alexzeitgeist]

Issue

Hi,

I am trying to override some default openai models to include an extra body parameter, as described here: https://platform.openai.com/docs/guides/flex-processing

This is what I have:

$ cat ~/.aider.model.settings.yml
- name: openai/o4-mini
  extra_params:
    extra_body:
      service_tier: "flex"

- name: openai/o3
  extra_params:
    extra_body:
      service_tier: "flex"

Aider shows that it is successfully loading the file:

Loaded model settings from:
  - /home/alex/.aider.model.settings.yml

However, according to OpenAI usage logs, aider continues to make non-flex requests. Am doing something wrong? Also, I tried --verbose, but couldn't find any details regarding Rest-API communication. Is there a way that I can see what payload exactly is being sent to the model?

Thanks for your help. Alex

Version and model info

Aider: 0.82.2 Main model: openai/o4-mini with architect edit format Editor model: azure/gpt-4.1 with editor-diff edit format Weak model: openai/gpt-4.1-mini

[alexzeitgeist]

Ok, turns out it must be supported by litellm. I will add a ticket there.

Btw, litellm==1.67 is out, adding support for o3 and o4-mini models.

[alexzeitgeist]

Hmm, I guess I must be doing something wrong, since it is supposed to work:

https://github.com/BerriAI/litellm/issues/10307

I also upgraded litellm to 1.67 with aider, but no luck. The api call to openai is without the service_tier parameter.

[matthid]

Hmm

- name: litellm_proxy/openai/o4-mini
  extra_params:
    service_tier: "flex"

This seems to work for me (but I'm using a hosted llm-proxy).