Localization is extremely slow with Ceres 2.2.0 Manifold

[MarkYu98]

After updating to Ceres 2.2.0 as enabled by b58d4fb4 the localization pipeline becomes significantly slower (e.g. on 7Scenes stairs 7.5min -> 40min, and for the single-case test script 3s -> 5s).