clustermq
clustermq copied to clipboard
dopar .errorhandling options are not working
trafficstars
Using clustermq as a foreach backend does not work as expected.
Typically the very important .errorhandling option does not seem to work, when .errorhandling = "pass" any error happening on the slave process should come back as an error object and all other results should be returned to the user.
It seems it is not working as per bellow
library(clustermq)
foo <- function(i)
{
if (i == 1)
return(10)
else if (i == 2)
return(20)
else
stop("nope...")
}
register_dopar_cmq(n_jobs = 5, memory = 40*1024, template = list(partition = partition))
res <- foreach(x_i = 1:3, .errorhandling = "pass") %dopar% foo(x_i)
#Master: [0.7s 18.4% CPU]; Worker: [avg 87.3% CPU, max 232.8 Mb]
#Error in summarize_result(job_result, n_errors, n_warnings, cond_msgs, :
# 1/3 jobs failed (0 warnings). Stopping.
# (Error #3) nope...
Many thanks for this great package, it helps tremendously
Yes, .errorhandling is not supported but should be.
Thank you for your interest in the package, it's nice to see it used!