Henrik Bengtsson

That's a great question - thanks for bringing it up. BTW, I assume you meant `availableCores()` rather than `availableWorkers()` - the latter may rely on the former in some cases....

This will be a long reply with lots of details: To understand how to achieve "early stopping", it's important to understand that there is no way for a parallel R...

Thanks - this is useful and I encourage everyone to join in a think hard about this problem. I should clarify that I've got this, and other limitations on my...

Hi, this an interesting idea. It's been a while I dove into the inner parts of `sparklyr`, but **if** it's now possible to "launch" a single expression on Spark, check...

See https://github.com/HenrikBengtsson/future/issues/339#issuecomment-533730606 for a slightly better solution that does not rely on using `persistent = TRUE` (which should be avoided). Define: ```r clusterExportSticky

Sorry, I'm a bit slow - you're talking `packageEvent(..., event = "onLoad")`, correct? Where should the hook function live, when should it be setup/added, in what cases should it be...

Are you saying that when `future` is loaded, it should override whatever backend is already set for (frontend) `foreach` with `doFuture::registerDoFuture()`, and same for BiocParallel, and so on? (I understand...

I see, so a `use_futures()` function? Can you give some mockup code with and without such a function, because I'm still not 100% sure what the advantage would be compared...

Are you saying it hangs when you use: ```r future::plan(list(future::multiprocess, future::sequential)) ``` but not ```r future::plan(future::multiprocess) ``` which effectively should be identical because when no more plans are specified, it'll...

Hi. I haven't had time to reproduce/troubleshoot your original problem, but I'm suspect you're hitting issues because _forked_ processes are in place (=`multiprocess` -> `multicore`) and some of the packages...