chatgpt-retrieval-plugin
chatgpt-retrieval-plugin copied to clipboard
Add MQ support to be HA
If there are large amounts of documents to upsert, we need a MQ. The reasons are follows:
-
/upsertAPI response cannot return quickly, if we want to build a real time platform, the service would be unstable. - If
OpenAI's API or datastore's API has incident, the process will lost, and we need to deal with the retry logic.