openai
Magic sauce is missing. Why is the API not equivalent to backend-api/conversation?
Describe the feature or improvement you're requesting
Thank you for your great work in providing an API. What seems strangely confusing is that the main use of a conversation_id is not part of the API. Not providing the main use of a chat context as a reference point leads to pointless data stored in memory, repeated requests within a chat, limitations regarding the no of tokens and unnecessary costs.
Since it is definitely technically feasible, as there is an API for the chat window, I wonder what the intention behind this is? Is it simply temporary? Before any workarounds are developed, and if so, when, is a full deployment planned? It also seems that other parties e.g. the companies of the demos have that ability?
Appreciate your guys work and thank you very much for your help!
