paper-qa
paper-qa copied to clipboard
Support adding multiple docs at once
Currently, each document uploaded requires an API call to get embeddings. Due to API rate-limits, this really slows the document adding process for large corpus.
This process could be parallelized better by implementing a multiple document adding method, which aggregates texts across documents and sends them all to get embeddings in one API call.