google-cloud-cpp icon indicating copy to clipboard operation
google-cloud-cpp copied to clipboard

Published 20 hours ago • verified publisher icon googleapis

Crash in Bazel when processing coverage data

Open coryan opened this issue 3 years ago • 16 comments

This seems to be in a crash in Bazel:

exec bazel-out/k8-fastbuild/bin/external/remote_coverage_tools/Main --coverage_dir=/h/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/sandbox/linux-sandbox/3211/execroot/com_github_googleapis_google_cloud_cpp/_coverage/google/cloud/storage/internal_grpc_resumable_upload_session_url_test/test --output_file=/h/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/sandbox/linux-sandbox/3211/execroot/com_github_googleapis_google_cloud_cpp/bazel-out/k8-fastbuild/testlogs/google/cloud/storage/internal_grpc_resumable_upload_session_url_test/coverage.dat --filter_sources=/usr/bin/.+ --filter_sources=/usr/lib/.+ --filter_sources=/usr/include.+ '--filter_sources=.*external/.+' --source_file_manifest=/h/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/sandbox/linux-sandbox/3211/execroot/com_github_googleapis_google_cloud_cpp/bazel-out/k8-fastbuild/bin/google/cloud/storage/internal_grpc_resumable_upload_session_url_test.instrumented_files
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGBUS (0x7) at pc=0x00007f9e096693b1, pid=12, tid=1994
#
# JRE version:  (16.0.1+9) (build )
# Java VM: OpenJDK 64-Bit Server VM (16.0.1+9, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, linux-amd64)
# Problematic frame:
# V  [libjvm.so+0xcc33b1]  PerfMemory::alloc(unsigned long)+0x61
#
# Core dump will be written. Default location: Core dumps may be processed with "/usr/share/apport/apport %p %s %c %d %P %E" (or dumping to /h/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/sandbox/linux-sandbox/3211/execroot/com_github_googleapis_google_cloud_cpp/core.12)
#
# An error report file with more information is saved as:
# /h/.cache/bazel/_bazel_root/eab0d61a99b6696edb3d2aff87b585e8/sandbox/linux-sandbox/3211/execroot/com_github_googleapis_google_cloud_cpp/hs_err_pid12.log

https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/6951/c49f09292f13b6e992099571ee350ed9c290e704/fedora-34-coverage/log-1b80ce6e-6c62-4536-9ce5-5e21939a3a2a.txt

coryan avatar Jul 07 '21 22:07 coryan

GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/cdc50265-715e-4ce2-918d-7941c38463c2;tab=detail?project=cloud-cpp-testing-resources Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/b6dd0b150d36b2f8f25cf899d669fa52558ecbb6/fedora-34-coverage/log-cdc50265-715e-4ce2-918d-7941c38463c2.txt

dbolduc avatar Sep 14 '21 21:09 dbolduc

GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/ed08e66c-a442-497d-be2d-fd67c118e3e5;tab=detail?project=cloud-cpp-testing-resources Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/2e533a8b9d5c88febf2483c846f46262a1c3de94/fedora-34-coverage/log-ed08e66c-a442-497d-be2d-fd67c118e3e5.txt

devbww avatar Nov 03 '21 22:11 devbww

GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/a0eb04bb-3094-482b-8806-e23aeffca4eb;tab=detail?project=cloud-cpp-testing-resources Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/b92933ba81c2e497e7daf239ce9872080da2828e/fedora-34-coverage/log-a0eb04bb-3094-482b-8806-e23aeffca4eb.txt

coryan avatar Nov 30 '21 18:11 coryan

GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/47b3f67b-30da-4b5f-9615-50b136377c30;tab=detail?project=cloud-cpp-testing-resources Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/bf0b040aed516355156be139dcf3417ea0e848a0/fedora-34-coverage/log-47b3f67b-30da-4b5f-9615-50b136377c30.txt

coryan avatar Jan 10 '22 15:01 coryan

Looks like the Envoy folks solved or at least avoid this problem by using llvm-cov instead of GCC:

https://github.com/bazelbuild/bazel/issues/7279

coryan avatar Jan 10 '22 15:01 coryan

GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/354900a0-bd00-404b-b899-0c1cb83fd8de;tab=detail?project=cloud-cpp-testing-resources Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/a5a5458e477dd24c0e07586d0f502de079b9a60f/fedora-34-coverage/log-354900a0-bd00-404b-b899-0c1cb83fd8de.txt

coryan avatar Feb 11 '22 18:02 coryan

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/4e34ab12-1aef-4c82-bf13-100e85454cf7;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/6c322a17954faaf2cdbec6378400c89a25b343b6/fedora-34-coverage/log-4e34ab12-1aef-4c82-bf13-100e85454cf7.txt

coryan avatar Apr 02 '22 13:04 coryan

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/8aa87fb5-6944-4f09-8a75-a3b7377313cd;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/79a15e3b1ca7b51d7705005ce0f19f531f9b7f62/fedora-35-coverage/log-8aa87fb5-6944-4f09-8a75-a3b7377313cd.txt

devbww avatar Apr 27 '22 20:04 devbww

Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/331db1234c3c662311ea54c1c7f835adc55d2d37/fedora-35-coverage/log-0b6de133-a2be-4882-88ee-2ce6db898a62.txt

scotthart avatar May 06 '22 18:05 scotthart

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/41c5b38d-2c2a-46fb-835b-3a44c4cda12c;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/8947/fc31c28a127b6553e6b0b3aa5e563b0c820a5906/fedora-35-coverage/log-41c5b38d-2c2a-46fb-835b-3a44c4cda12c.txt

coryan avatar May 12 '22 17:05 coryan

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/f77b102c-f79e-4dc7-880a-22d547f56eea;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/6e4e59a61cef63d7f909799e4752842629f3bdc7/fedora-35-coverage/log-f77b102c-f79e-4dc7-880a-22d547f56eea.txt

dbolduc avatar May 15 '22 17:05 dbolduc

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/9c420ae0-1d39-419e-9401-6dac91409489;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/8849ab9a3dc5f805bed39255445b0c8f71ff1c57/fedora-35-coverage/log-9c420ae0-1d39-419e-9401-6dac91409489.txt

dbolduc avatar Jun 10 '22 06:06 dbolduc

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/11d2941f-37b9-4a2d-83c0-3a2097d637ad;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/9a2a1f1d840386a3549ef99e6b0fb8d2680d1eae/fedora-35-coverage/log-11d2941f-37b9-4a2d-83c0-3a2097d637ad.txt

coryan avatar Jul 20 '22 03:07 coryan

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/8af6f648-cd54-46bb-89ef-ead45f359d30;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/5b4e07fb63665314dae61bb0933917a657ed2757/fedora-36-coverage/log-8af6f648-cd54-46bb-89ef-ead45f359d30.txt

dbolduc avatar Aug 08 '22 17:08 dbolduc

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/f73787b2-1394-463d-bb81-ebd5788810bb;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/62c475defbe2b874876ba68aeb9f8fd954042340/fedora-36-coverage/log-f73787b2-1394-463d-bb81-ebd5788810bb.txt

dbolduc avatar Aug 12 '22 19:08 dbolduc

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/10110806-7fbf-465c-a9d2-5b8ff99989f4;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/b7eca0ee4326815d973326088549a6c9d0d23b23/fedora-36-coverage/log-10110806-7fbf-465c-a9d2-5b8ff99989f4.txt

devbww avatar Sep 21 '22 06:09 devbww

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/496d89f5-6179-4d21-8a0e-61b97e31b033;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/03f7c7d17e5541ff069d5eb84154a0dc4fdd3c37/fedora-36-coverage/log-496d89f5-6179-4d21-8a0e-61b97e31b033.txt

coryan avatar Sep 28 '22 14:09 coryan

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/556aa64b-0549-475f-a519-6a59d389da4a;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/6336ea726bf600a55e767eab7227d6462ea6d78a/fedora-36-coverage/log-556aa64b-0549-475f-a519-6a59d389da4a.txt

coryan avatar Oct 29 '22 18:10 coryan

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/1bae28d8-880d-4441-8056-04b7ad180414;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/56e58465f889fec426a86d4916e4e582b0777011/fedora-36-coverage/log-1bae28d8-880d-4441-8056-04b7ad180414.txt

coryan avatar Oct 29 '22 18:10 coryan

  • GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/0e927f35-1d5b-45de-980f-04b6ddddf7b5;tab=detail?project=cloud-cpp-testing-resources
  • Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/5727b803bb0b5aad54bd05ee53d6fef9ea457305/fedora-36-coverage/log-0e927f35-1d5b-45de-980f-04b6ddddf7b5.txt

coryan avatar Nov 07 '22 17:11 coryan

Possibly related to https://github.com/bazelbuild/bazel/issues/3236 there is a recommendation to use --sandbox_tmpfs_path=/tmp I will try that in a PR

coryan avatar Nov 07 '22 17:11 coryan

We think this is fixed.

coryan avatar Mar 29 '23 18:03 coryan