Amelia icon indicating copy to clipboard operation
Amelia copied to clipboard

R fatal error RAM limit

Open joh4nd opened this issue 1 year ago • 0 comments

RStudio crashes running Amelia on a 324000 rows x 17 cols dataframe at about 11GiB: "R session aborted. R encountered a fatal error. The session was terminated".

Would be nice with suggestions for (a) how to deal with memory issues or (b) features actually dealing with it. E.g. running on a distributed system or on a local database rather than in memory.

MI <- amelia(x = data,
    m = 1, 
    p2s = 1,
    idvars = c("index","var2"),
    noms = c("var3","var4"),
    ords = "var5",
    ts = "dt",
    cs = "var1",
    empri = 0.05 * nrow(data),
    polytime = 2,
    intercs = TRUE,
    bounds = matrix(c(11,0,1000, 12,0,1000, 13,0,1000), nrow = 3, ncol = 3, byrow = TRUE),
    parallel = 'multicore',
    ncpus = 8,
    collect = TRUE)

Amelia has no problem running on subsets of the data i.e. one of 1-10 datasets indicated by var2.

Debian Bullseye

joh4nd avatar Nov 16 '23 07:11 joh4nd