[Question] Inquiry on Best Practices for Deploying Stateful Agent-Services

[BaiMoHan]

I would like to consult about the best practices for deploying services, particularly in scenarios involving stateful agent-services.

Currently, I have a program running, and I have added some new features. The traditional approach for stateless services would be to start a new instance of the program, redirect the traffic to the new instance, and then shut down the old one. This ensures a seamless transition for users.

However, I am working with a worker that maintains an agent, which caches conversation history and is thus a stateful service. What would be the recommended deployment practices in this case to ensure a smooth update without disrupting the user experience? Any insights or strategies would be greatly appreciated!