nodejs-spanner icon indicating copy to clipboard operation
nodejs-spanner copied to clipboard

Spanner: "after all" hook in "Spanner" failed

Open flaky-bot[bot] opened this issue 3 years ago • 13 comments

Note: #1565 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.


commit: 622e01f6e601f93460e7f6c0fb3f95fcf1bd2791 buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Cannot delete instance projects/long-door-651/instances/gcloud-tests-instance-a5ad8794 because it contains backups. Please delete the backups before deleting the instance.
Error: 9 FAILED_PRECONDITION: Cannot delete instance projects/long-door-651/instances/gcloud-tests-instance-a5ad8794 because it contains backups. Please delete the backups before deleting the instance.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:180:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:343:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:129:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:182:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:323:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Mar 05 '22 13:03 flaky-bot[bot]

commit: e6cf8cb79939dd56435f4cca99799c01234bc162 buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-ae0b5952/backups/gcloud-tests-backup-07ccdc27 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-ae0b5952/backups/gcloud-tests-backup-07ccdc27 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:180:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:343:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:129:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Mar 21 '22 10:03 flaky-bot[bot]

commit: 9439ca4cf260923a7cb90e0568864cb719ab8fc6 buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-a03c5ee9/backups/gcloud-tests-backup-de214490 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-a03c5ee9/backups/gcloud-tests-backup-de214490 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:180:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:343:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:129:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Mar 21 '22 19:03 flaky-bot[bot]

Looks like this issue is flaky. :worried:

I'm going to leave this open and stop commenting.

A human should fix and close this.


commit: cefb1b4c831997e5c52122c5e6c3fd9cd9cb2c76 buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-06356619/backups/gcloud-tests-backup-491eb511 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-06356619/backups/gcloud-tests-backup-491eb511 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:180:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:343:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:129:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Mar 24 '22 07:03 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 8bcbd95e7423f03aa16ffd500fca998f75c8d0cf buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-276f9f3c/backups/gcloud-tests-backup-d751b551 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-276f9f3c/backups/gcloud-tests-backup-d751b551 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:180:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:343:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:129:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Mar 29 '22 17:03 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 8bcbd95e7423f03aa16ffd500fca998f75c8d0cf buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-c4b91d02/backups/gcloud-tests-backup-c5d9c7c3 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-c4b91d02/backups/gcloud-tests-backup-c5d9c7c3 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:180:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:343:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:129:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Mar 31 '22 10:03 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: d9b31537e4130bf5578e32823f7af2a81cc9c9c9 buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-8169873f/backups/gcloud-tests-backup-1a767310 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-8169873f/backups/gcloud-tests-backup-1a767310 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:180:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:343:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:129:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Apr 05 '22 10:04 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: bf60e2993f71dbc602b84796178ece3ce2c9c187 buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-df0a3adc/backups/gcloud-tests-backup-bdcd2df7 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-df0a3adc/backups/gcloud-tests-backup-bdcd2df7 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:180:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:343:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:130:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Apr 09 '22 10:04 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 7df71fc64cec2446ff5f5aacce65b14380c8501e buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-c56ae70f/backups/gcloud-tests-backup-46f7b9aa cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-c56ae70f/backups/gcloud-tests-backup-46f7b9aa cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:189:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:351:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:130:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Apr 27 '22 10:04 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: c358d668ca2a25f99ab73a4b6c1ebbe09c34d4de buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-78e75eee/backups/gcloud-tests-backup-b401d9a4 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-78e75eee/backups/gcloud-tests-backup-b401d9a4 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:189:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:351:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:130:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Apr 27 '22 19:04 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: c358d668ca2a25f99ab73a4b6c1ebbe09c34d4de buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-ba00cccd/backups/gcloud-tests-backup-1fb5bad6 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-ba00cccd/backups/gcloud-tests-backup-1fb5bad6 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:189:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:351:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:130:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Apr 28 '22 10:04 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 1367aa7dc9818be5610dfc5ae67d09652e7009e5 buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-dcb9d89a/backups/gcloud-tests-backup-cb78741e cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-dcb9d89a/backups/gcloud-tests-backup-cb78741e cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:189:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:351:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:130:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar May 20 '22 10:05 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 781cdacfe0dee0991ac15193e383cc31f13fdf29 buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-2f95f144/backups/gcloud-tests-backup-5ff293c4 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-2f95f144/backups/gcloud-tests-backup-5ff293c4 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:26)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:24
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:189:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:351:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:130:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)

flaky-bot[bot] avatar Jun 29 '22 10:06 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: d91a02fb9387408af8d868072df675e98143c022 buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-7da6bc85/backups/gcloud-tests-backup-8430dffd cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-7da6bc85/backups/gcloud-tests-backup-8430dffd cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:19)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:17
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:190:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:352:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:130:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:187:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)
for call at
    at ServiceClientImpl.makeUnaryRequest (node_modules/@grpc/grpc-js/build/src/client.js:160:30)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:324:26
    at ServiceClientImpl. (node_modules/@grpc/grpc-js/build/src/make-client.js:105:19)
        -> /workspace/node_modules/@grpc/grpc-js/src/make-client.ts:189:15
    at /workspace/build/src/v1/database_admin_client.js:288:29
        -> /workspace/src/v1/database_admin_client.ts:419:25
    at /workspace/node_modules/google-gax/build/src/normalCalls/timeout.js:44:16
        -> /workspace/node_modules/google-gax/src/normalCalls/timeout.ts:54:13
    at repeat (node_modules/google-gax/build/src/normalCalls/retries.js:80:25)
        -> /workspace/node_modules/google-gax/src/normalCalls/retries.ts:104:19
    at /workspace/node_modules/google-gax/build/src/normalCalls/retries.js:118:13
        -> /workspace/node_modules/google-gax/src/normalCalls/retries.ts:144:7
    at OngoingCall.call (node_modules/google-gax/build/src/call.js:67:27)
        -> /workspace/node_modules/google-gax/src/call.ts:81:23
    at NormalApiCaller.call (node_modules/google-gax/build/src/normalCalls/normalApiCaller.js:34:19)
        -> /workspace/node_modules/google-gax/src/normalCalls/normalApiCaller.ts:43:15
    at /workspace/node_modules/google-gax/build/src/createApiCall.js:81:30
        -> /workspace/node_modules/google-gax/src/createApiCall.ts:116:26

flaky-bot[bot] avatar Aug 10 '22 10:08 flaky-bot[bot]

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 9283f4bdfaea0ceececacbb80df3c37bd522b657 buildURL: Build Status, Sponge status: failed

Test output
9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-78c86983/backups/gcloud-tests-backup-fdf3a911 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
Error: 9 FAILED_PRECONDITION: Backup projects/long-door-651/instances/gcloud-tests-instance-78c86983/backups/gcloud-tests-backup-fdf3a911 cannot be deleted at the moment because it is still in use by 1 databases for pending restore activity. Please try deleting the backup once the restore or post-restore optimize operations have completed on these databases. The databases using this backup are displayed in the UI in the Backups table `In use by` column, and returned by the GetBackup API.
    at Object.callErrorFromStatus (node_modules/@grpc/grpc-js/build/src/call.js:31:19)
        -> /workspace/node_modules/@grpc/grpc-js/src/call.ts:81:17
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client.js:190:52)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:352:36
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:111:35
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:206:27
    at Object.onReceiveStatus (node_modules/grpc-gcp/build/src/index.js:73:29)
        -> /workspace/node_modules/grpc-gcp/src/index.ts:130:15
    at InterceptingListenerImpl.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/call-stream.js:106:23)
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:202:19
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:365:141)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:462:34
    at Object.onReceiveStatus (node_modules/@grpc/grpc-js/build/src/client-interceptors.js:328:181)
        -> /workspace/node_modules/@grpc/grpc-js/src/client-interceptors.ts:424:48
    at /workspace/node_modules/@grpc/grpc-js/build/src/call-stream.js:188:78
        -> /workspace/node_modules/@grpc/grpc-js/src/call-stream.ts:330:24
    at processTicksAndRejections (internal/process/task_queues.js:79:11)
for call at
    at ServiceClientImpl.makeUnaryRequest (node_modules/@grpc/grpc-js/build/src/client.js:160:30)
        -> /workspace/node_modules/@grpc/grpc-js/src/client.ts:324:26
    at ServiceClientImpl. (node_modules/@grpc/grpc-js/build/src/make-client.js:105:19)
        -> /workspace/node_modules/@grpc/grpc-js/src/make-client.ts:189:15
    at /workspace/build/src/v1/database_admin_client.js:288:29
        -> /workspace/src/v1/database_admin_client.ts:418:25
    at /workspace/node_modules/google-gax/build/src/normalCalls/timeout.js:44:16
        -> /workspace/node_modules/google-gax/src/normalCalls/timeout.ts:54:13
    at repeat (node_modules/google-gax/build/src/normalCalls/retries.js:80:25)
        -> /workspace/node_modules/google-gax/src/normalCalls/retries.ts:104:19
    at /workspace/node_modules/google-gax/build/src/normalCalls/retries.js:118:13
        -> /workspace/node_modules/google-gax/src/normalCalls/retries.ts:144:7
    at OngoingCall.call (node_modules/google-gax/build/src/call.js:67:27)
        -> /workspace/node_modules/google-gax/src/call.ts:81:23
    at NormalApiCaller.call (node_modules/google-gax/build/src/normalCalls/normalApiCaller.js:34:19)
        -> /workspace/node_modules/google-gax/src/normalCalls/normalApiCaller.ts:43:15
    at /workspace/node_modules/google-gax/build/src/createApiCall.js:84:30
        -> /workspace/node_modules/google-gax/src/createApiCall.ts:118:26

flaky-bot[bot] avatar Aug 25 '22 10:08 flaky-bot[bot]