500 server error inference.memgpt.ai/chat/completions

[quantumalchemy]

Describe the bug handling asyncio exception {'message': 'Future exception was never retrieved', 'exception': HTTPError('500 Server Error: Internal Server Error for url: https://inference.memgpt.ai/chat/completions'), 'future': <Future finished exception=HTTPError('500 Server Error: Internal Server Error for url: https://inference.memgpt.ai/chat/completions')>}

Please describe your setup

• [ ] How did you install memgpt? git clone https://github.com/cpacker/MemGPT.git pip install -e .
• [ ] Describe your setup Linux

Additional context always getting this error on the https://inference.memgpt.ai/ endpoint always after 2 - 4 rounds of Q&A

MemGPT Config [defaults] preset = memgpt_chat persona = sam_pov human = basic

[model] model = memgpt-openai model_endpoint = https://inference.memgpt.ai model_endpoint_type = openai context_window = 8192

[embedding] embedding_endpoint_type = hugging-face embedding_endpoint = https://embeddings.memgpt.ai embedding_model = BAAI/bge-large-en-v1.5 embedding_dim = 1024 embedding_chunk_size = 300

[archival_storage] type = chroma path = /root/.memgpt/chroma

[recall_storage] type = sqlite path = /root/.memgpt

[metadata_storage] type = sqlite path = /root/.memgpt

[version] memgpt_version = 0.3.15

[client] anon_clientid = 000000000000000000004a04625d6283

** CLI --> memgpt run
Hit enter to begin (will request first MemGPT message)

An exception occurred when running agent.step(): Traceback (most recent call last): File "/MemGPT/memgpt/main.py", line 408, in run_agent_loop new_messages, user_message, skip_next_user_input = process_agent_step(user_message, no_verify) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/MemGPT/memgpt/main.py", line 377, in process_agent_step new_messages, heartbeat_request, function_failed, token_warning, tokens_accumulated = memgpt_agent.step( ^^^^^^^^^^^^^^^^^^ File "/MemGPT/memgpt/agent.py", line 818, in step raise e File "/MemGPT/memgpt/agent.py", line 733, in step response = self._get_ai_reply( ^^^^^^^^^^^^^^^^^^^ File "/MemGPT/memgpt/agent.py", line 451, in _get_ai_reply raise e File "/MemGPT/memgpt/agent.py", line 426, in _get_ai_reply response = create( ^^^^^^^ File "/MemGPT/memgpt/llm_api/llm_api_tools.py", line 106, in wrapper return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/MemGPT/memgpt/llm_api/llm_api_tools.py", line 204, in create return openai_chat_completions_request( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/MemGPT/memgpt/llm_api/openai.py", line 377, in openai_chat_completions_request raise http_err File "/MemGPT/memgpt/llm_api/openai.py", line 367, in openai_chat_completions_request response.raise_for_status() # Raises HTTPError for 4XX/5XX status ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://inference.memgpt.ai/chat/completions