paper-qa icon indicating copy to clipboard operation
paper-qa copied to clipboard

Processing files during indexing using multiprocessing for speed boost

Open jamesbraza opened this issue 1 year ago • 0 comments

Coming from https://github.com/Future-House/paper-qa/pull/628#issuecomment-2435055914.

A huge speedup can be attained by moving our indexing's paperqa.agents.search.process_file implementation from asyncio to multiprocessing.

jamesbraza avatar Oct 25 '24 18:10 jamesbraza