paper-qa icon indicating copy to clipboard operation
paper-qa copied to clipboard

Support adding multiple docs at once

Open jhohrath opened this issue 2 years ago • 0 comments

Currently, each document uploaded requires an API call to get embeddings. Due to API rate-limits, this really slows the document adding process for large corpus.

This process could be parallelized better by implementing a multiple document adding method, which aggregates texts across documents and sends them all to get embeddings in one API call.

jhohrath avatar Nov 17 '23 22:11 jhohrath