chatgpt-retrieval-plugin
chatgpt-retrieval-plugin copied to clipboard
Add MQ support to be HA
If there are large amounts of documents to upsert, we need a MQ. The reasons are follows:
-
/upsert
API response cannot return quickly, if we want to build a real time platform, the service would be unstable. - If
OpenAI
's API or datastore's API has incident, the process will lost, and we need to deal with the retry logic.