google-cloud-cpp [Flake] iam_samples: service is currently unavailable

2022-08-23T14:52:42.871774000Z [DEBUG] <140010620792512> QueryTestablePermissions() << google.iam.admin.v1.QueryTestablePermissionsRequest {
  full_resource_name: "//iam.googleapis.com/projects/cloud-cpp-testing-resources/serviceAccounts/[email protected]"
} (./google/cloud/internal/log_wrapper.h:91)
2022-08-23T14:52:47.887830000Z [DEBUG] <140010620792512> QueryTestablePermissions() >> status=UNAVAILABLE: The service is currently unavailable. (./google/cloud/internal/log_wrapper.h:94)
libc++abi: terminating with uncaught exception of type std::runtime_error: Error in non-idempotent operation QueryTestablePermissions: The service is currently unavailable.

GCB: https://console.cloud.google.com/cloud-build/builds;region=us-east1/5675238e-b71b-4114-9cd3-b8d6fdaeb029;tab=detail?project=cloud-cpp-testing-resources
Raw: https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/a4356c26e063a059372e43c3d3f0792d3be9070c/fedora-36-ubsan/log-5675238e-b71b-4114-9cd3-b8d6fdaeb029.txt

Aug 23 '22 15:08 devbww

More than 90d without repeats. Closing.

Dec 05 '22 20:12 coryan

https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/4a48807ca4920187d2ef91bd9ed5441ed2497909/fedora-37-bazel-xsan/log-94e12ad1-74e9-4d85-ac27-6e8e7bb0a5d5.txt

Mar 14 '23 15:03 scotthart

In that last error log I see:

Step #3: google::cloud::Status thrown: UNAVAILABLE: Error in non-idempotent operation QueryGrantableRoles: The service is currently unavailable.

Maybe this is just another RPC that should be treated as idempotent. Something called Query* looks read-only to me.

Mar 14 '23 16:03 coryan

Hopefully #11045 will help mitigate the occurrence of this flake.

Mar 15 '23 20:03 scotthart

No repeats in 90d, and at least two mitigations in place. Closing.

Jul 12 '23 19:07 coryan

occurred in pubsub iam_samples

https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/main/4c08bde3b81c67df5b7bd1134e8412fc5a6b7d6f/fedora-msan-msan-default/log-7cdd3fce-702f-4cfd-9b1b-9a17e6c855d7.txt

Aug 08 '24 18:08 scotthart