bootleg icon indicating copy to clipboard operation
bootleg copied to clipboard

Batch processing on label_mentions is not working

Open coolcoder001 opened this issue 2 years ago • 1 comments

Hi @lorr1 ,

Is it possible to have batch processing for label_mentions method? Currently it is taking a list of sentences, but internally in the code, I can see it is processing one sentence at a time. Is it possible to do this batchwise to speed up the process?

coolcoder001 avatar Jun 17 '22 06:06 coolcoder001

Hey. It would be possible for sure. Setting up some worker queue for the processing.

It's not on my immediate roadmap to solve (as we have offline extract_mentions and dump_preds methods for batch processing). They are in our end2end tutorial.

lorr1 avatar Jun 18 '22 18:06 lorr1