kernel-memory icon indicating copy to clipboard operation
kernel-memory copied to clipboard

Streaming AskAsync response

Open cz35iek opened this issue 8 months ago • 5 comments

Hi,

We're using your library in our project. It get us up to speed preety fast in these new AI topics, so thank you for that :).

I was wondering if there is an option to recieve streaming response from our semantic memory service. This could improve user experience, to recieve some first tokens of response instead of waiting for whole thing. OpenAI chatgpt is working this way.

BR, Dawid

cz35iek avatar Oct 18 '23 07:10 cz35iek