High overhead on KNL for LULESH2.0

[twang15]

@tgamblin @davidbeckingsale Caliper overhead on KNL (LULESH2.0) is 20%. What would be the possible cause?

#configurations CALI_CONFIG_PROFILE = serial-trace ICC 17.0.4 Linked w/ iomp5 or gomp (results similar)

#threads | O3 | O3 w/ caliper instrumentation | overhead ------------ | ------------- 8 | 33.77 | 42.18 | -0.199 16 | 21.55 | 25.44 | -0.153 32 | 21.81 | 24.84 | -0.122 64 | 24.83 | 28.13 | -0.117 128 | 24.98 | 27.01 | -0.075 256 | 30.72 | 32.92 | -0.067