caret-machine-learning icon indicating copy to clipboard operation
caret-machine-learning copied to clipboard

excessive memory use of rFerns in parallel use

Open tobigithub opened this issue 10 years ago • 2 comments

method rFerns 0.9353 0.9021 58.45 Random Ferns in caret uses 2 Gbyte per parallel client, so 32 clients require at least 64 GByte RAM. Method works and converges, just memory use seems excessive (plus speed).

tobigithub avatar Nov 13 '15 00:11 tobigithub

rFerns author here; this is because both rFerns model size and training time scales with 2^depth, and caret scans the entire 1-16 range of its possible values. Going over 12 is simply impractical in most use cases, even if it brings some minor accuracy gain.

mbq avatar May 20 '16 16:05 mbq

Thank you. Tobias

tobigithub avatar May 20 '16 19:05 tobigithub