litellm icon indicating copy to clipboard operation
litellm copied to clipboard

[Bug]: /file Unable to use files_settings with Azure config unless env vars are explicitly set

Open lloukmane opened this issue 7 months ago • 4 comments

What happened?

Hi team,

We’re encountering an issue when using files_settings in the config file to define a custom Azure provider. Here's the configuration we’re using:

files_settings:
  - custom_llm_provider: azure
    api_base: https://resource.openai.azure.com
    api_key: os.environ/MY_KEY
    api_version: "my_version"

Despite providing api_base, api_key, and api_version in the config, we receive the below error.

It seems like litellm still expects env vars listed in proxy_server_config.yaml even though the config file explicitly defines everything.

Relevant log output

{
  "error": {
    "message": "Must provide one of the `base_url` or `azure_endpoint` arguments, or the `AZURE_OPENAI_ENDPOINT` environment variable",
    "type": "None",
    "param": "None",
    "code": "500"
  }
}

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

1.57.0

Twitter / LinkedIn details

No response

lloukmane avatar May 05 '25 10:05 lloukmane

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

github-actions[bot] avatar Aug 04 '25 00:08 github-actions[bot]

Can we get some attention on this. This makes the files endpoints completely unusable

Bharat23 avatar Aug 07 '25 23:08 Bharat23

+1

MohammedSamirMahmoud avatar Aug 28 '25 09:08 MohammedSamirMahmoud

+1

francisrafal avatar Nov 21 '25 15:11 francisrafal

Agreed, it's not working.

DmacMcgreg avatar Nov 28 '25 15:11 DmacMcgreg