[Failing Test]: SpannerReadIT.testReadWithDataBoost failing

[Abacn]

What happened?

Affecting beam_PreCommit_Java_GCP_IO_Direct, e.g.: https://ci-beam.apache.org/view/PostCommit/job/beam_PreCommit_Java_GCP_IO_Direct_Cron/1121/testReport/junit/org.apache.beam.sdk.io.gcp.spanner/SpannerReadIT/testReadWithDataBoost/

Error message:

org.apache.beam.sdk.Pipeline$PipelineExecutionException: com.google.cloud.spanner.SpannerException: PERMISSION_DENIED: io.grpc.StatusRuntimeException: PERMISSION_DENIED: This instance (projects/apache-beam-testing/instances/beam-test) is not allowed to use DataBoost at this time. Please contact [email protected] for more information.

The test was added in Apr 4th in #26007 but test start failing on Apr 7th. Possibly due to recent roll out of gcp service that included permission changes? CC: @darshan-sj

If needed we should add the permission to the service account used for Jenkins

Issue Failure

Failure: Test is continually failing

Issue Priority

Priority: 2 (backlog / disabled test but we think the product is healthy)

Issue Components

• [ ] Component: Python SDK
• [X] Component: Java SDK
• [ ] Component: Go SDK
• [ ] Component: Typescript SDK
• [X] Component: IO connector
• [ ] Component: Beam examples
• [ ] Component: Beam playground
• [ ] Component: Beam katas
• [ ] Component: Website
• [ ] Component: Spark Runner
• [ ] Component: Flink Runner
• [ ] Component: Samza Runner
• [ ] Component: Twister2 Runner
• [ ] Component: Hazelcast Jet Runner
• [ ] Component: Google Cloud Dataflow Runner

[Abacn]

CC: @jrmccluskey just FYI another failing test affecting also release branch. Though the issue is not in Beam side.

[darshan-sj]

Working on this.

[darshan-sj]

The feature is now enabled for the test project and instance and the error has stopped occurring now.

[darshan-sj]

Recent successful CI build -- https://ci-beam.apache.org/view/PostCommit/job/beam_PreCommit_Java_GCP_IO_Direct_Cron/1166/testReport/org.apache.beam.sdk.io.gcp.spanner/SpannerReadIT/

[Abacn]

The test now failing again:

09:47:30 org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testReadWithDataBoost FAILED
09:47:30     java.lang.RuntimeException at SpannerReadIT.java:214

It stucks for hours and causing the test suite timeout.

[johnjcasey]

@darshan-sj can you take a look at this again?

[Abacn]

@darshan-sj

as of Apr 2024 the test is still disabled. Could you please take a look?