EconML icon indicating copy to clipboard operation
EconML copied to clipboard

Memory issues when N is increased too much

Open JFernandoGR opened this issue 2 years ago • 0 comments

Dear EconML support team.

I am using Causal Forests for calculating CATEs, and the main issue I am facing is that confidence intervals calculated (CIs) are too large with my dataset. After reading QA information, the first solution is increasing the number of trees (nestimators) until the CATEs variance is controlled. The problem is that having ~100K obs, 2K estimators pose large problems of memory. Apart from trying with other hyperparameters, could you provide tips for dealing with it? (I have set up njobs equal to -1).

JFernandoGR avatar May 26 '22 17:05 JFernandoGR