profanity-filter icon indicating copy to clipboard operation
profanity-filter copied to clipboard

Parallelize censoring

Open rominf opened this issue 5 years ago • 2 comments

I think dask is a good solution because it has a nice API and can be used in a cluster.

The easiest and most effective parallelization is to map words after tokenization.

rominf avatar Mar 22 '19 13:03 rominf

Blocked by #10.

rominf avatar Mar 22 '19 14:03 rominf

Do it through REST web service (see #19).

rominf avatar Apr 13 '19 19:04 rominf