Request to utilize FastAPI for wrapping and enabling seamless responses.

[nebstudio]

This project is truly remarkable; however, I encounter some difficulties when running it, as it lacks an API. I recommend employing FastAPI to expose its capabilities and enable streaming output, which I greatly appreciate. Another concern is whether it can be adapted into a conversational format, rather than being confined to individual sessions.

[salvinoto]

I am working in this right now with @shroominic. More details and documentation will come soon.

[shroominic]

It is already a conversational format you just have to do multiple requests to the same session. If you close the session the chat history is deleted.