[Bug]: LiteLLM Enterprise Package missing on litellm proxy

[Classic298]

What happened?

After upgrading to 1.69.0, i got the error that litellm_enterprise package could not be found.

This is new, and was not mentioned in the release notes, that there is now a new package that is needed for LiteLLM to work. Can you install it yourself upon upgrading? Or at least put it in the release notes please

Thanks

Relevant log output

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

1.69.1

Twitter / LinkedIn details

No response

[ishaan-jaff]

hi @Classic298 could you show me the stack trace you see?

Is this with litellm python SDK or proxy server ?

[Classic298]

@ishaan-jaff litellm[proxy] python package

I'll try to get you the stacktrace tomorrow.

[ishaan-jaff]

do you build from docker ?

[ishaan-jaff]

This is odd because we have litellm-enterprise pip as a dep here

[Classic298]

@krrishdholakia @ishaan-jaff

No I do not build from docker, I installed litellm[proxy] via pip

May 13 13:42:58 systemd[1]: Started litellm.service - LiteLLM AI Gateway.
May 13 13:43:01 litellm[359962]: Traceback (most recent call last):
May 13 13:43:01 litellm[359962]:   File "/opt/litellm/venv/lib/python3.11/site-packages/litellm/proxy/proxy_cli.py", line 507, in run_server
May 13 13:43:01 litellm[359962]:     from .proxy_server import (
May 13 13:43:01 litellm[359962]:   File "/opt/litellm/venv/lib/python3.11/site-packages/litellm/proxy/proxy_server.py", line 224, in <module>
May 13 13:43:01 litellm[359962]:     from litellm.proxy.management_endpoints.internal_user_endpoints import (
May 13 13:43:01 litellm[359962]:   File "/opt/litellm/venv/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py", line 27, in <module>
May 13 13:43:01 litellm[359962]:     from litellm.proxy.hooks.user_management_event_hooks import UserManagementEventHooks
May 13 13:43:01 litellm[359962]:   File "/opt/litellm/venv/lib/python3.11/site-packages/litellm/proxy/hooks/user_management_event_hooks.py", line 10, in <module>
May 13 13:43:01 litellm[359962]:     from litellm_enterprise.enterprise_callbacks.send_emails.base_email import (
May 13 13:43:01 litellm[359962]: ModuleNotFoundError: No module named 'litellm_enterprise'
May 13 13:43:01 litellm[359962]: During handling of the above exception, another exception occurred:
May 13 13:43:01 litellm[359962]: Traceback (most recent call last):
May 13 13:43:01 litellm[359962]:   File "/opt/litellm/venv/bin/litellm", line 8, in <module>
May 13 13:43:01 litellm[359962]:     sys.exit(run_server())
May 13 13:43:01 litellm[359962]:              ^^^^^^^^^^^^
May 13 13:43:01 litellm[359962]:   File "/opt/litellm/venv/lib/python3.11/site-packages/click/core.py", line 1161, in __call__
May 13 13:43:01 litellm[359962]:     return self.main(*args, **kwargs)
May 13 13:43:01 litellm[359962]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 13:43:01 litellm[359962]:   File "/opt/litellm/venv/lib/python3.11/site-packages/click/core.py", line 1082, in main
May 13 13:43:01 litellm[359962]:     rv = self.invoke(ctx)
May 13 13:43:01 litellm[359962]:          ^^^^^^^^^^^^^^^^
May 13 13:43:01 litellm[359962]:   File "/opt/litellm/venv/lib/python3.11/site-packages/click/core.py", line 1443, in invoke
May 13 13:43:01 litellm[359962]:     return ctx.invoke(self.callback, **ctx.params)
May 13 13:43:01 litellm[359962]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 13:43:01 litellm[359962]:   File "/opt/litellm/venv/lib/python3.11/site-packages/click/core.py", line 788, in invoke
May 13 13:43:01 litellm[359962]:     return __callback(*args, **kwargs)
May 13 13:43:01 litellm[359962]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 13:43:01 litellm[359962]:   File "/opt/litellm/venv/lib/python3.11/site-packages/litellm/proxy/proxy_cli.py", line 519, in run_server
May 13 13:43:01 litellm[359962]:     from proxy_server import (
May 13 13:43:01 litellm[359962]: ModuleNotFoundError: No module named 'proxy_server'
May 13 13:43:02 systemd[1]: litellm.service: Main process exited, code=exited, status=1/FAILURE
May 13 13:43:02 systemd[1]: litellm.service: Failed with result 'exit-code'.
May 13 13:43:02 systemd[1]: litellm.service: Consumed 3.074s CPU time.
May 13 13:43:12 systemd[1]: litellm.service: Scheduled restart job, restart counter is at 12.
May 13 13:43:12 systemd[1]: Stopped litellm.service - LiteLLM AI Gateway.

[MalteHB]

Experience the same issue. Why is litellm_enterprise necessary for the regular litellm package?

[krrishdholakia]

It's not. We were missing a good script to detect these unsafe imports.

Fixing now.