SuperTripleM

Limiting the tokens per minute doesn't work

2

I want to limit the tokens per minute (tpm) to under 30000 tokens to avoid errors like: "litellm.exceptions.RateLimitError: litellm.RateLimitError: RateLimitError: OpenAIException - Request too large for gpt-5 in organization org-123456...