Tyler Rinker

Dump everything out to temp rds and read back to the clusters...add a library arg

Initial attempts leads to error on Windows (~~parallel seems to be using an old version of R and throws an error with regard to Rcpp being the wrong version~~ fixed...

http://appliedpredictivemodeling.com/blog/2018/1/17/parallel-processing Is either of the following a better way to run parallel code: https://github.com/r-lib/callr https://github.com/r-lib/processx A OS independent solution is needed. Re investigate available solutions and reach out to the...

Here's where I ask the R community: https://twitter.com/tylerrinker/status/1044364197797265408 - https://github.com/HenrikBengtsson/future recommended by Julia Silge - https://github.com/DavisVaughan/furrr recommended by Garrett Mooney

Thinking to not include in algorithm but as a separate detector.

@bazarnov This is a difficult problem. There are no current plans to release this feature.

Can you make both parts of this reproducible. The stringi package has tools to generate andom text that you can use to mimic the data you're talking about.

**sentimentr** works at the sentence level. So in the example you provide a split into sentences produced ~500K sentences. This runs for me but will certainly consume a bit of...

> What puzzles me though, is that data.table has been conceived not only for speed, but also memory efficiency. Its "by-reference" paradigm aims specifically at minimising all internal copies which...

Not surprisingly...the comma_reducer is causing huge memory use. Per Marco's aprof: