mem0 icon indicating copy to clipboard operation
mem0 copied to clipboard

Async Memory Client Support for self-hosted

Open hayescode opened this issue 8 months ago • 2 comments

🚀 The feature

I use Azure AI Search for mem0 and it's working great, however the mem0.memory.Memory client is syncronous and is blocking my flow adding latency. It seems the AsyncMemroyClient is only for the hosted version which I cannot use at my company. Azure AI Search can be async and I could make a PR to add it but there would need to be an AsyncMemory class in mem0.memory.main.py to use this. This situation seems like a common use case so I'm wondering if it's planned or there is some other reason it does not already exist?

Motivation, pitch

Async is critical for high concurrency and scalability. There should be an option to choose Sync/Async for self-hosted memory.

hayescode avatar Apr 02 '25 13:04 hayescode

Thanks for the feature request @hayescode. The team is already working on this and we plan to release it really soon.

cc @Dev-Khant

deshraj avatar Apr 02 '25 17:04 deshraj

Awesome thank you! Looking forward to it!

hayescode avatar Apr 02 '25 17:04 hayescode