chatgpt-retrieval-plugin icon indicating copy to clipboard operation
chatgpt-retrieval-plugin copied to clipboard

Add MQ support to be HA

Open yaalsn opened this issue 1 year ago • 0 comments

If there are large amounts of documents to upsert, we need a MQ. The reasons are follows:

  • /upsert API response cannot return quickly, if we want to build a real time platform, the service would be unstable.
  • If OpenAI's API or datastore's API has incident, the process will lost, and we need to deal with the retry logic.

yaalsn avatar Mar 26 '23 10:03 yaalsn