[Bug]: UI not loading due to in-memory session management

[johnnyaug]

Is there an existing issue for the same bug?

• [X] I have checked the troubleshooting document at https://opendevin.github.io/OpenDevin/modules/usage/troubleshooting
• [X] I have checked the existing issues.

Describe the bug

I'm wondering about the new session management, particularly the fact that it's persisted in-memory. When I'm using multiple backend workers, the UI can't load the file explorer, because the request to list-files gets to a worker which is not familiar with my session.

If I repeat the list-files request, it works occasionally when it's lucky enough to go through the worker where the session is persisted.

Current Version

0eccf316

Installation and Configuration

LLM_MODEL="gpt-3.5-turbo-0125"
LLM_API_KEY="<redacted>"
WORKSPACE_BASE="/Users/yoni/OpenDevin/workspace"
WORKSPACE_MOUNT_PATH="/Users/yoni/OpenDevin/workspace"
SANDBOX_TYPE="ssh"
JWT_SECRET="<redacted>"

Model and Agent

No response

Reproduction Steps

1. Start the server with 8 workers.

   uvicorn.run('listen:app', host='0.0.0.0', port=3000, workers=8)
   

2. Open the UI and wait for the engine to load.

Logs, Errors, Screenshots, and Additional Context

No response