DataflowTemplates
DataflowTemplates copied to clipboard
GoogleCloudPlatform
[Bug]: Import via spanner UI fails
Related Template(s)
GCS_Avro_to_Cloud_Spanner
Template Version
2025-09-02-00_RC00
What happened?
export was created via spanner UI export and import fails after few minutes and it looks like it tries to create the same table twice
FAILED_PRECONDITION: Duplicate name in schema: access_scheme_page_actions FAILED_PRECONDITION: Table data_access_cache_allowed_ids does not reference parent key column data_access_cache_id
{
"textPayload": "Error message from worker: org.apache.beam.sdk.util.UserCodeException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/r16082daa_5a43_4403_8f74_e5308123caed\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Duplicate name in schema: access_scheme_page_actions.\n\torg.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForWindowObservingParDo(FnApiDoFnRunner.java:638)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1318)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.access$2700(FnApiDoFnRunner.java:138)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:1856)\n\torg.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)\n\torg.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:625)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:228)\n\torg.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:231)\n\torg.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:527)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)\n\tjava.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)\n\tjava.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\torg.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tjava.base/java.lang.Thread.run(Thread.java:840)\nCaused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/r16082daa_5a43_4403_8f74_e5308123caed\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Duplicate name in schema: access_scheme_page_actions.\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5.processElement(ImportTransform.java:714)\nCaused by: java.util.concurrent.ExecutionException: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/r16082daa_5a43_4403_8f74_e5308123caed\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Duplicate name in schema: access_scheme_page_actions.\n\tcom.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:594)\n\tcom.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:469)\n\tcom.google.common.util.concurrent.FluentFuture$TrustedFuture.get(FluentFuture.java:99)\n\tcom.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:75)\n\tcom.google.api.gax.longrunning.OperationFutureImpl.get(OperationFutureImpl.java:131)\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5.processElement(ImportTransform.java:710)\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForWindowObservingParDo(FnApiDoFnRunner.java:638)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1318)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.access$2700(FnApiDoFnRunner.java:138)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:1856)\n\torg.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)\n\torg.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:625)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:228)\n\torg.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:231)\n\torg.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:527)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)\n\tjava.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)\n\tjava.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\torg.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tjava.base/java.lang.Thread.run(Thread.java:840)\nCaused by: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/r16082daa_5a43_4403_8f74_e5308123caed\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Duplicate name in schema: access_scheme_page_actions.\n\tcom.google.cloud.spanner.SpannerExceptionFactory.newSpannerExceptionPreformatted(SpannerExceptionFactory.java:346)\n\tcom.google.cloud.spanner.SpannerExceptionFactory.fromApiException(SpannerExceptionFactory.java:366)\n\tcom.google.cloud.spanner.SpannerExceptionFactory.newSpannerException(SpannerExceptionFactory.java:186)\n\tcom.google.cloud.spanner.SpannerExceptionFactory.newSpannerException(SpannerExceptionFactory.java:115)\n\tcom.google.cloud.spanner.DatabaseAdminClientImpl.lambda$updateDatabaseDdl$11(DatabaseAdminClientImpl.java:470)\n\tcom.google.api.core.ApiFutures$ApiFunctionToGuavaFunction.apply(ApiFutures.java:396)\n\tcom.google.common.util.concurrent.AbstractCatchingFuture$CatchingFuture.doFallback(AbstractCatchingFuture.java:237)\n\tcom.google.common.util.concurrent.AbstractCatchingFuture$CatchingFuture.doFallback(AbstractCatchingFuture.java:225)\n\tcom.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:135)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:809)\n\tcom.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:129)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.api.gax.retrying.BasicRetryingFuture.handleAttempt(BasicRetryingFuture.java:205)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.handle(CallbackChainRetryingFuture.java:135)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.run(CallbackChainRetryingFuture.java:115)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.common.util.concurrent.AbstractTransformFuture$TransformFuture.setResult(AbstractTransformFuture.java:259)\n\tcom.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:171)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.api.gax.retrying.BasicRetryingFuture.handleAttempt(BasicRetryingFuture.java:205)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.handle(CallbackChainRetryingFuture.java:135)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.run(CallbackChainRetryingFuture.java:115)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.api.core.AbstractApiFuture$InternalSettableFuture.set(AbstractApiFuture.java:87)\n\tcom.google.api.core.AbstractApiFuture.set(AbstractApiFuture.java:70)\n\tcom.google.api.gax.grpc.GrpcExceptionCallable$ExceptionTransformingFuture.onSuccess(GrpcExceptionCallable.java:88)\n\tcom.google.api.core.ApiFutures$1.onSuccess(ApiFutures.java:89)\n\tcom.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1137)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tio.grpc.stub.ClientCalls$GrpcFuture.set(ClientCalls.java:646)\n\tio.grpc.stub.ClientCalls$UnaryStreamToFuture.onClose(ClientCalls.java:619)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tcom.google.api.gax.grpc.ChannelPool$ReleasingClientCall$1.onClose(ChannelPool.java:569)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tcom.google.cloud.spanner.spi.v1.SpannerErrorInterceptor$1$1.onClose(SpannerErrorInterceptor.java:107)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tcom.google.api.gax.grpc.GrpcLoggingInterceptor$1$1.onClose(GrpcLoggingInterceptor.java:98)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tio.grpc.census.CensusStatsModule$StatsClientInterceptor$1$1.onClose(CensusStatsModule.java:814)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tio.grpc.census.CensusTracingModule$TracingClientInterceptor$1$1.onClose(CensusTracingModule.java:494)\n\tio.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:565)\n\tio.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:72)\n\tio.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:733)\n\tio.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:714)\n\tio.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)\n\tio.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)\n\t... 3 more\n",
"insertId": "mte5mhcf20",
"resource": {
"type": "dataflow_step",
"labels": {
"job_name": "cloud-spanner-import-dev-instance-test-core-local-dtest-prod",
"step_id": "",
"region": "us-east4",
"project_id": "data-project",
"job_id": "2025-09-05_08_34_16-12951479253143003823"
}
},
"timestamp": "2025-09-05T15:38:04.031276700Z",
"severity": "ERROR",
"labels": {
"dataflow.googleapis.com/job_name": "cloud-spanner-import-dev-instance-test-core-local-dtest-prod",
"dataflow.googleapis.com/log_type": "system",
"dataflow.googleapis.com/region": "us-east4",
"dataflow.googleapis.com/job_id": "2025-09-05_08_34_16-12951479253143003823"
},
"logName": "projects/data-project/logs/dataflow.googleapis.com%2Fjob-message",
"receiveTimestamp": "2025-09-05T15:38:04.197484310Z"
}
{
"textPayload": "Error message from worker: org.apache.beam.sdk.util.UserCodeException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/r1bc34faf_b449_43a3_8caa_2e31193d9b9f\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Duplicate name in schema: access_scheme_page_actions.\n\torg.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForWindowObservingParDo(FnApiDoFnRunner.java:638)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1318)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.access$2700(FnApiDoFnRunner.java:138)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:1856)\n\torg.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)\n\torg.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:625)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:228)\n\torg.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:231)\n\torg.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:527)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)\n\tjava.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)\n\tjava.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\torg.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tjava.base/java.lang.Thread.run(Thread.java:840)\nCaused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/r1bc34faf_b449_43a3_8caa_2e31193d9b9f\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Duplicate name in schema: access_scheme_page_actions.\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5.processElement(ImportTransform.java:714)\nCaused by: java.util.concurrent.ExecutionException: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/r1bc34faf_b449_43a3_8caa_2e31193d9b9f\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Duplicate name in schema: access_scheme_page_actions.\n\tcom.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:594)\n\tcom.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:469)\n\tcom.google.common.util.concurrent.FluentFuture$TrustedFuture.get(FluentFuture.java:99)\n\tcom.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:75)\n\tcom.google.api.gax.longrunning.OperationFutureImpl.get(OperationFutureImpl.java:131)\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5.processElement(ImportTransform.java:710)\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForWindowObservingParDo(FnApiDoFnRunner.java:638)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1318)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.access$2700(FnApiDoFnRunner.java:138)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:1856)\n\torg.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)\n\torg.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:625)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:228)\n\torg.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:231)\n\torg.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:527)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)\n\tjava.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)\n\tjava.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\torg.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tjava.base/java.lang.Thread.run(Thread.java:840)\nCaused by: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/r1bc34faf_b449_43a3_8caa_2e31193d9b9f\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Duplicate name in schema: access_scheme_page_actions.\n\tcom.google.cloud.spanner.SpannerExceptionFactory.newSpannerExceptionPreformatted(SpannerExceptionFactory.java:346)\n\tcom.google.cloud.spanner.SpannerExceptionFactory.fromApiException(SpannerExceptionFactory.java:366)\n\tcom.google.cloud.spanner.SpannerExceptionFactory.newSpannerException(SpannerExceptionFactory.java:186)\n\tcom.google.cloud.spanner.SpannerExceptionFactory.newSpannerException(SpannerExceptionFactory.java:115)\n\tcom.google.cloud.spanner.DatabaseAdminClientImpl.lambda$updateDatabaseDdl$11(DatabaseAdminClientImpl.java:470)\n\tcom.google.api.core.ApiFutures$ApiFunctionToGuavaFunction.apply(ApiFutures.java:396)\n\tcom.google.common.util.concurrent.AbstractCatchingFuture$CatchingFuture.doFallback(AbstractCatchingFuture.java:237)\n\tcom.google.common.util.concurrent.AbstractCatchingFuture$CatchingFuture.doFallback(AbstractCatchingFuture.java:225)\n\tcom.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:135)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:809)\n\tcom.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:129)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.api.gax.retrying.BasicRetryingFuture.handleAttempt(BasicRetryingFuture.java:205)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.handle(CallbackChainRetryingFuture.java:135)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.run(CallbackChainRetryingFuture.java:115)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.common.util.concurrent.AbstractTransformFuture$TransformFuture.setResult(AbstractTransformFuture.java:259)\n\tcom.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:171)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.api.gax.retrying.BasicRetryingFuture.handleAttempt(BasicRetryingFuture.java:205)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.handle(CallbackChainRetryingFuture.java:135)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.run(CallbackChainRetryingFuture.java:115)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.api.core.AbstractApiFuture$InternalSettableFuture.set(AbstractApiFuture.java:87)\n\tcom.google.api.core.AbstractApiFuture.set(AbstractApiFuture.java:70)\n\tcom.google.api.gax.grpc.GrpcExceptionCallable$ExceptionTransformingFuture.onSuccess(GrpcExceptionCallable.java:88)\n\tcom.google.api.core.ApiFutures$1.onSuccess(ApiFutures.java:89)\n\tcom.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1137)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tio.grpc.stub.ClientCalls$GrpcFuture.set(ClientCalls.java:646)\n\tio.grpc.stub.ClientCalls$UnaryStreamToFuture.onClose(ClientCalls.java:619)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tcom.google.api.gax.grpc.ChannelPool$ReleasingClientCall$1.onClose(ChannelPool.java:569)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tcom.google.cloud.spanner.spi.v1.SpannerErrorInterceptor$1$1.onClose(SpannerErrorInterceptor.java:107)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tcom.google.api.gax.grpc.GrpcLoggingInterceptor$1$1.onClose(GrpcLoggingInterceptor.java:98)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tio.grpc.census.CensusStatsModule$StatsClientInterceptor$1$1.onClose(CensusStatsModule.java:814)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tio.grpc.census.CensusTracingModule$TracingClientInterceptor$1$1.onClose(CensusTracingModule.java:494)\n\tio.grpc.internal.DelayedClientCall$DelayedListener$3.run(DelayedClientCall.java:489)\n\tio.grpc.internal.DelayedClientCall$DelayedListener.delayOrExecute(DelayedClientCall.java:453)\n\tio.grpc.internal.DelayedClientCall$DelayedListener.onClose(DelayedClientCall.java:486)\n\tio.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:565)\n\tio.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:72)\n\tio.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:733)\n\tio.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:714)\n\tio.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)\n\tio.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)\n\t... 3 more\n",
"insertId": "mte5mhcf1y",
"resource": {
"type": "dataflow_step",
"labels": {
"project_id": "data-project",
"job_name": "cloud-spanner-import-dev-instance-test-core-local-dtest-prod",
"step_id": "",
"region": "us-east4",
"job_id": "2025-09-05_08_34_16-12951479253143003823"
}
},
"timestamp": "2025-09-05T15:37:37.506824815Z",
"severity": "ERROR",
"labels": {
"dataflow.googleapis.com/log_type": "system",
"dataflow.googleapis.com/region": "us-east4",
"dataflow.googleapis.com/job_id": "2025-09-05_08_34_16-12951479253143003823",
"dataflow.googleapis.com/job_name": "cloud-spanner-import-dev-instance-test-core-local-dtest-prod"
},
"logName": "projects/data-project/logs/dataflow.googleapis.com%2Fjob-message",
"receiveTimestamp": "2025-09-05T15:37:38.175578302Z"
}
{
"textPayload": "Error message from worker: org.apache.beam.sdk.util.UserCodeException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/rb68e2fe5_92f7_492a_a723_11efeeb913cf\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Table data_access_cache_allowed_ids does not reference parent key column data_access_cache_id.\n\torg.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForWindowObservingParDo(FnApiDoFnRunner.java:638)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1318)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.access$2700(FnApiDoFnRunner.java:138)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:1856)\n\torg.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)\n\torg.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:625)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:228)\n\torg.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:231)\n\torg.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:527)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)\n\tjava.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)\n\tjava.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\torg.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tjava.base/java.lang.Thread.run(Thread.java:840)\nCaused by: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/rb68e2fe5_92f7_492a_a723_11efeeb913cf\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Table data_access_cache_allowed_ids does not reference parent key column data_access_cache_id.\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5.processElement(ImportTransform.java:714)\nCaused by: java.util.concurrent.ExecutionException: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/rb68e2fe5_92f7_492a_a723_11efeeb913cf\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Table data_access_cache_allowed_ids does not reference parent key column data_access_cache_id.\n\tcom.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:594)\n\tcom.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:469)\n\tcom.google.common.util.concurrent.FluentFuture$TrustedFuture.get(FluentFuture.java:99)\n\tcom.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:75)\n\tcom.google.api.gax.longrunning.OperationFutureImpl.get(OperationFutureImpl.java:131)\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5.processElement(ImportTransform.java:710)\n\tcom.google.cloud.teleport.spanner.ImportTransform$CreateTables$5$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForWindowObservingParDo(FnApiDoFnRunner.java:638)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1318)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.access$2700(FnApiDoFnRunner.java:138)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:1856)\n\torg.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)\n\torg.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)\n\torg.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:625)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:349)\n\torg.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:276)\n\torg.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:228)\n\torg.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:231)\n\torg.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:527)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)\n\torg.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)\n\tjava.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)\n\tjava.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\torg.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tjava.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tjava.base/java.lang.Thread.run(Thread.java:840)\nCaused by: com.google.cloud.spanner.SpannerException: FAILED_PRECONDITION: Operation with name \"projects/data-project/instances/dev-instance/databases/test-core-local-dtest-prod/operations/rb68e2fe5_92f7_492a_a723_11efeeb913cf\" failed with status = GrpcStatusCode{transportCode=FAILED_PRECONDITION} and message = Table data_access_cache_allowed_ids does not reference parent key column data_access_cache_id.\n\tcom.google.cloud.spanner.SpannerExceptionFactory.newSpannerExceptionPreformatted(SpannerExceptionFactory.java:346)\n\tcom.google.cloud.spanner.SpannerExceptionFactory.fromApiException(SpannerExceptionFactory.java:366)\n\tcom.google.cloud.spanner.SpannerExceptionFactory.newSpannerException(SpannerExceptionFactory.java:186)\n\tcom.google.cloud.spanner.SpannerExceptionFactory.newSpannerException(SpannerExceptionFactory.java:115)\n\tcom.google.cloud.spanner.DatabaseAdminClientImpl.lambda$updateDatabaseDdl$11(DatabaseAdminClientImpl.java:470)\n\tcom.google.api.core.ApiFutures$ApiFunctionToGuavaFunction.apply(ApiFutures.java:396)\n\tcom.google.common.util.concurrent.AbstractCatchingFuture$CatchingFuture.doFallback(AbstractCatchingFuture.java:237)\n\tcom.google.common.util.concurrent.AbstractCatchingFuture$CatchingFuture.doFallback(AbstractCatchingFuture.java:225)\n\tcom.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:135)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:809)\n\tcom.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:129)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.api.gax.retrying.BasicRetryingFuture.handleAttempt(BasicRetryingFuture.java:205)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.handle(CallbackChainRetryingFuture.java:135)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.run(CallbackChainRetryingFuture.java:115)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.common.util.concurrent.AbstractTransformFuture$TransformFuture.setResult(AbstractTransformFuture.java:259)\n\tcom.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:171)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.api.gax.retrying.BasicRetryingFuture.handleAttempt(BasicRetryingFuture.java:205)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.handle(CallbackChainRetryingFuture.java:135)\n\tcom.google.api.gax.retrying.CallbackChainRetryingFuture$AttemptCompletionListener.run(CallbackChainRetryingFuture.java:115)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tcom.google.api.core.AbstractApiFuture$InternalSettableFuture.set(AbstractApiFuture.java:87)\n\tcom.google.api.core.AbstractApiFuture.set(AbstractApiFuture.java:70)\n\tcom.google.api.gax.grpc.GrpcExceptionCallable$ExceptionTransformingFuture.onSuccess(GrpcExceptionCallable.java:88)\n\tcom.google.api.core.ApiFutures$1.onSuccess(ApiFutures.java:89)\n\tcom.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1137)\n\tcom.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:31)\n\tcom.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1298)\n\tcom.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:1059)\n\tcom.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:784)\n\tio.grpc.stub.ClientCalls$GrpcFuture.set(ClientCalls.java:646)\n\tio.grpc.stub.ClientCalls$UnaryStreamToFuture.onClose(ClientCalls.java:619)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tcom.google.api.gax.grpc.ChannelPool$ReleasingClientCall$1.onClose(ChannelPool.java:569)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tcom.google.cloud.spanner.spi.v1.SpannerErrorInterceptor$1$1.onClose(SpannerErrorInterceptor.java:107)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tcom.google.api.gax.grpc.GrpcLoggingInterceptor$1$1.onClose(GrpcLoggingInterceptor.java:98)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tio.grpc.census.CensusStatsModule$StatsClientInterceptor$1$1.onClose(CensusStatsModule.java:814)\n\tio.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)\n\tio.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)\n\tio.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)\n\tio.grpc.census.CensusTracingModule$TracingClientInterceptor$1$1.onClose(CensusTracingModule.java:494)\n\tio.grpc.internal.DelayedClientCall$DelayedListener$3.run(DelayedClientCall.java:489)\n\tio.grpc.internal.DelayedClientCall$DelayedListener.delayOrExecute(DelayedClientCall.java:453)\n\tio.grpc.internal.DelayedClientCall$DelayedListener.onClose(DelayedClientCall.java:486)\n\tio.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:565)\n\tio.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:72)\n\tio.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:733)\n\tio.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:714)\n\tio.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)\n\tio.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)\n\t... 3 more\n",
"insertId": "mte5mhcf1x",
"resource": {
"type": "dataflow_step",
"labels": {
"step_id": "",
"job_name": "cloud-spanner-import-dev-instance-test-core-local-dtest-prod",
"job_id": "2025-09-05_08_34_16-12951479253143003823",
"project_id": "data-project",
"region": "us-east4"
}
},
"timestamp": "2025-09-05T15:37:26.515803765Z",
"severity": "ERROR",
"labels": {
"dataflow.googleapis.com/job_name": "cloud-spanner-import-dev-instance-test-core-local-dtest-prod",
"dataflow.googleapis.com/region": "us-east4",
"dataflow.googleapis.com/log_type": "system",
"dataflow.googleapis.com/job_id": "2025-09-05_08_34_16-12951479253143003823"
},
"logName": "projects/data-project/logs/dataflow.googleapis.com%2Fjob-message",
"receiveTimestamp": "2025-09-05T15:37:27.161383276Z"
}
Relevant log output
it looks like the problem is with table with 'SYNONYM' i.e.
CREATE TABLE
data_access_cache_allowed_ids_2025_07_30 (
...
SYNONYM(data_access_cache_allowed_ids),
)
i.e. export (Cloud_Spanner_to_GCS_Avro) saves synonym as separate table and import fails
as workaround works next In spanner-export.json
- removed all rows for tables which actually synonyms
- moved rows of original tables into place of synonyms (I am not sure if this needed, but probably it helps with dependencies)
- import as usual via UI
import works but synonyms are lost and should be re-added manually