RateLimitError: Exceeded OpenAI API Quota Leading to LLMProviderError Despite 0% Usage on Apple M2 Pro

[frieda-huang]

Hi there!

I keep getting the following errors when trying out any of the Skyvern Templates. Despite my OpenAI API usage being at 0%, I’m encountering a RateLimitError which subsequently causes an LLMProviderError when using the OPENAI_GPT4_TURBO LLM provider. I am running this on an Apple M2 Pro.

 File "/Users/friedahuang/Library/Caches/pypoetry/virtualenvs/skyvern-KFgdp60p-py3.11/lib/python3.11/site-packages/litellm/utils.py", line 7779, in exception_type
    raise RateLimitError(
litellm.exceptions.RateLimitError: OpenAIException - Error code: 429 - {'error': {'message': 'You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs: https://platform.openai.com/docs/guides/error-codes/api-errors.', 'type': 'insufficient_quota', 'param': None, 'code': 'insufficient_quota'}}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/friedahuang/Documents/skyvern/skyvern/forge/agent.py", line 520, in agent_step
    json_response = await app.LLM_API_HANDLER(
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/friedahuang/Documents/skyvern/skyvern/forge/sdk/api/llm/api_handler_factory.py", line 204, in llm_api_handler
    raise LLMProviderError(llm_key) from e
skyvern.forge.sdk.api.llm.exceptions.LLMProviderError: Error while using LLMProvider OPENAI_GPT4_TURBO

Steps to Reproduce

1. Follow Quickstart instructions and run on http://localhost:8080.
2. Attempt to use any of the Skyvern Templates with the OpenAI API.
3. Observe the rate limit being exceeded.
4. Notice the resulting RateLimitError and the subsequent LLMProviderError.