[all] enable eigen optimizations and handling crashes

[ghost]

Eigen optimizations were disabled previously as they were causing crashes.

This PR enables back those optimizations and handle the crash by using various tricks to make sure alignment of Eigen objects are ok.