[Bug]: Update to guardrails ai does not take effect

[thedevd]

What happened?

I was giving demo to stakeholders, I added a guardrails using guradrails ai, and configured it to pre_call and default ON. So far good. However I wanted to change default from ON to Off, so I changed it using ui. But even after updating the guardrails, still call is using the older configuration. This also applies to the case where I want to remove the guardrails which I had created with default ON, I meant even after deleting the guardrails the litellm still applies it.

The only way to refresh the configuration, is to restart LLM.

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

1.75.8

Twitter / LinkedIn details

No response

[thedevd]

++ @ishaan-jaff

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.