EconML
EconML copied to clipboard
SparseLinearDRLearner doesn't shrink point estimates to zero at all
Hi, thanks for the amazing library!
I have some problems while experimenting with the SparseLinearDRLearner, and I hope I could borrow your mind on them.
-
In my case, I have about 10000 samples and about 50 features in the CATE function, and I wish to obtain a sparse version of the function by using SparseLinearDRLearner. However, it seems that the SparseLinearDRLearner won't shrink any point estimates to zero at all regardless of the value of alpha (0.0001 to 10000). Could you explain why this may happen?
-
When comparing the results of SparseLinearDRLearner and LinearDRLearner, I found that the point then p-values and confidence intervals presented in the summary tables can be very different for the same features. For example, for some feature A, the result of the SparseLinearDRLearner states that the p-value is 0.001 whereas that of the LinearDRLearner is 0.6, hence giving a totally different insight. How would you interpret this dichotomy? Thanks!