paper-qa
paper-qa copied to clipboard
Processing files during indexing using multiprocessing for speed boost
Coming from https://github.com/Future-House/paper-qa/pull/628#issuecomment-2435055914.
A huge speedup can be attained by moving our indexing's paperqa.agents.search.process_file implementation from asyncio to multiprocessing.