llama_index icon indicating copy to clipboard operation
llama_index copied to clipboard

[Feature Request]: Allow ChatEngine to use async memory buffer?

Open yanqianglu opened this issue 6 months ago • 1 comments

Feature Description

The memory in ChatEngine can only be synchronous even in the async methods like (achat, achat_stream), for example this line in CondensePlusContextChatEngine.

Reason

I think it's common to have a chat memory backed by async DB calls, the current code stops people using async chat memory with chat engine without heavily customizing the chat engine.

Value of Feature

No response

yanqianglu avatar Aug 12 '24 00:08 yanqianglu