BROCCOLI icon indicating copy to clipboard operation
BROCCOLI copied to clipboard

Elastic net regularization for GLM?

Open mmbannert opened this issue 6 years ago • 2 comments

Dear Anders,

I was wondering if it would be feasible to implement elastic net regularization in GLM. It would be cool to estimate weights for very large design matrices with regularization at the speed of light :) Is there hope for this to come into existence?

Best, Michael

mmbannert avatar Apr 17 '18 11:04 mmbannert

Hi Michael,

to do a grid search for different L1 / L2 regularization settings is rather easy, but for first level fMRI there is temporal autocorrelation, which means that each voxel will have its own design matrix due to prewhitening. That part is therefore tricky to implement, and BROCCOLI currently does that partly on the CPU (4 iterations Cochrane-Orcutt).

  • Anders

2018-04-17 13:46 GMT+02:00 Michael Bannert [email protected]:

Dear Anders,

I was wondering if it would be feasible to implement elastic net regularization in GLM. It would be cool to estimate weights for very large design matrices with regularization at the speed of light :) Is there hope for this to come into existence?

Best, Michael

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/wanderine/BROCCOLI/issues/49, or mute the thread https://github.com/notifications/unsubscribe-auth/AEGryFZZqoDY-uB2mwZMFnkUPq5Z6gYlks5tpdYKgaJpZM4TYJNC .

-- Anders Eklund, PhD

wanderine avatar Apr 24 '18 08:04 wanderine

Hey Anders, Right, I forgot about each voxel getting its own design matrix. Yes, it makes sense that this is not the highest priority for BROCCOLI. Thanks & best, Michael

mmbannert avatar Apr 30 '18 08:04 mmbannert