presidio
presidio copied to clipboard
add support for multiprocessing to spacy pipelines
Is your feature request related to a problem? Please describe. The BatchAnalyzerEngine which calls the Spacy engine's process_batch method doesn't seem to pass through any kwargs for setting the n_process or batch size.
Describe the solution you'd like We should update process_batch to pass through kwargs to spacy's pipe method.
Describe alternatives you've considered Haven't considered any.
Additional context N/A