arm64/ubuntu build pipeline is slower as compared to x64/ubuntu

[lalitb]

          > "arm64/ubuntu" ci build ~5 min, while "x64/ubuntu" is ~3 min, and "x64/macOS" is ~2min. Need to check with "actuated" build, and if any compiler level optimization required for ARM.

Ok. I don't have an ARM machine to profile the build. One way to troubleshoot could be to add profiling as part of CI, and measure time build/test for each component. This can be handled separately. As of now, it is important to have the CI for ARM, so that we know there is build latency as compared to x64. Will create separate issue to debug further.

Originally posted by @lalitb in https://github.com/open-telemetry/opentelemetry-rust/issues/1884#issuecomment-2174649870