persian-spell-checker-kenlm icon indicating copy to clipboard operation
persian-spell-checker-kenlm copied to clipboard

Published 20 hours ago • verified publisher icon pooya-mohammadi

"processing cleaning jobs" takes too long

Open Mousavi-Parisa opened this issue 1 year ago • 0 comments

Hello Pooya! Thanks for your useful repository. I was going through the read.me you've prepared and running the steps but reading each sentence of the corpus after the preprocess takes too long! something about 1896 hours while the number of workers is set to 40! Do you recommend any more easy-processing way?

Mousavi-Parisa avatar Dec 03 '23 13:12 Mousavi-Parisa