go icon indicating copy to clipboard operation
go copied to clipboard

Published 20 hours ago • verified publisher icon golang

x/build/internal/task: test failures with `signal: killed` on darwin

Open gopherbot opened this issue 1 year ago • 7 comments 

#!watchflakes
post <- goos == "darwin" && pkg == "golang.org/x/build/internal/task" && `git command failed: signal: killed`

Issue created automatically to collect these failures.

Example (log):

--- FAIL: TestUpdateProxyTestRepo (72.20s)
    updateproxytestrepo_test.go:34: git push --tags error: git command failed: signal: killed, stderr

— watchflakes

gopherbot avatar Nov 14 '23 07:11 gopherbot

Found new dashboard test flakes for:

#!watchflakes
default <- pkg == "golang.org/x/build/internal/task" && test == "TestUpdateProxyTestRepo"
2023-11-10 23:32 darwin-amd64-13 build@e10b185a go@42bd21be x/build/internal/task.TestUpdateProxyTestRepo (log) 
--- FAIL: TestUpdateProxyTestRepo (72.20s)
    updateproxytestrepo_test.go:34: git push --tags error: git command failed: signal: killed, stderr

— watchflakes

gopherbot avatar Nov 14 '23 07:11 gopherbot

I suspect this is another symptom of #63937.

bcmills avatar Nov 14 '23 14:11 bcmills

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "darwin" && pkg == "golang.org/x/build/internal/task" && `git command failed: signal: killed`
2023-09-22 19:29 darwin-amd64-12_0 build@433076bf go@de3bae19 x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (65.35s)
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-09-25 20:39:18.905557 -0700 PDT m=+11.981991598	task Select repositories: LOG: Examining repositories [mod tools build sys]
    tagx_test.go:605: task Select repositories: done: [{mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc0007cc210 0xc0007cc228 0xc0007cc240] 1.16 v1.1.5 } {build golang.org/x/build [0xc0007cc258 0xc0007cc270]   } {sys golang.org/x/sys []  v0.1.0 }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task tools: wait for submit: started
    tagx_test.go:601: task tools: generate go.mod: started
...
        ]
    tagx_test.go:601: task tools: mail go.mod: started
    tagx_test.go:605: task tools: mail go.mod: done: cl_7bcf32cefff813a6866965fe313deda91a54de37
    tagx_test.go:601: task tools: wait for submit: started
    tagx_test.go:623: 2023-09-25 20:40:18.866756 -0700 PDT m=+71.943191019	task tools: wait for submit: LOG: Awaiting review/submit of (unparseable change ID "cl_7bcf32cefff813a6866965fe313deda91a54de37")
    tagx_test.go:605: task tools: wait for submit: done: 7bcf32cefff813a6866965fe313deda91a54de37
    tagx_test.go:601: task tools: wait for green post-submit: started
    tagx_test.go:623: 2023-09-25 20:40:18.917388 -0700 PDT m=+71.993822320	task tools: wait for green post-submit: LOG: task failed, will retry (1 of 3): listing project "tools" tags: git command failed: signal: killed, stderr 
    tagx_test.go:601: task tools: wait for green post-submit: started
    tagx_test.go:469: context deadline exceeded
2023-09-27 02:35 darwin-amd64-12_0 build@5d3521b0 go@5152be39 x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (91.31s)
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-09-26 19:45:02.074048 -0700 PDT m=+15.875628018	task Select repositories: LOG: Examining repositories [sys mod tools build]
    tagx_test.go:605: task Select repositories: done: [{sys golang.org/x/sys []  v0.1.0 } {mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc00056cde0 0xc00056cdf8 0xc00056ce10] 1.16 v1.1.5 } {build golang.org/x/build [0xc00056ce28 0xc00056ce40]   }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task tools: mail go.mod: started
    tagx_test.go:601: task sys: wait for green post-submit: started
...
    tagx_test.go:601: task mod: tag if appropriate: started
    tagx_test.go:605: task mod: tag if appropriate: done: {mod golang.org/x/mod []  v1.0.0 v1.0.0}
    tagx_test.go:605: task sys: wait for green post-submit: done: 809e1dc4a09ba8203e68d1ece8e097c7e38ecbb0
    tagx_test.go:601: task sys: tag if appropriate: started
    tagx_test.go:623: 2023-09-26 19:45:19.441705 -0700 PDT m=+33.243285100	task sys: tag if appropriate: LOG: Tagging sys at 809e1dc4a09ba8203e68d1ece8e097c7e38ecbb0 as v0.2.0
    tagx_test.go:605: task sys: tag if appropriate: done: {sys golang.org/x/sys []  v0.1.0 v0.2.0}
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:623: 2023-09-26 19:46:02.164881 -0700 PDT m=+75.966460579	task tools: generate go.mod: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-3463493718'...
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:469: context deadline exceeded
2023-09-27 02:35 darwin-amd64-12_0 build@5d3521b0 go@a15ef1bb x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (79.41s)
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-09-26 19:47:34.300647 -0700 PDT m=+18.494665009	task Select repositories: LOG: Examining repositories [sys mod tools build]
    tagx_test.go:605: task Select repositories: done: [{sys golang.org/x/sys []  v0.1.0 } {mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc000544450 0xc000544480 0xc000544498] 1.16 v1.1.5 } {build golang.org/x/build [0xc0005444b0 0xc0005444c8]   }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task build: mail go.mod: started
    tagx_test.go:601: task build: wait for submit: started
...
    tagx_test.go:601: task mod: tag if appropriate: started
    tagx_test.go:605: task mod: tag if appropriate: done: {mod golang.org/x/mod []  v1.0.0 v1.0.0}
    tagx_test.go:605: task sys: wait for green post-submit: done: 475d426cd4f392776f380a4b2b38a6ab7dbef7b6
    tagx_test.go:601: task sys: tag if appropriate: started
    tagx_test.go:623: 2023-09-26 19:48:17.857991 -0700 PDT m=+62.052009153	task sys: tag if appropriate: LOG: Tagging sys at 475d426cd4f392776f380a4b2b38a6ab7dbef7b6 as v0.2.0
    tagx_test.go:605: task sys: tag if appropriate: done: {sys golang.org/x/sys []  v0.1.0 v0.2.0}
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:623: 2023-09-26 19:48:34.45264 -0700 PDT m=+78.646658432	task tools: generate go.mod: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-3607395922'...
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:469: context deadline exceeded
2023-09-28 19:51 darwin-amd64-12_0 build@7f885397 go@fa4f9510 x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (76.08s)
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-09-29 12:37:00.074804 -0700 PDT m=+13.879835326	task Select repositories: LOG: Examining repositories [sys mod tools build]
    tagx_test.go:605: task Select repositories: done: [{sys golang.org/x/sys []  v0.1.0 } {mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc000114e88 0xc000114ea0 0xc000114eb8] 1.16 v1.1.5 } {build golang.org/x/build [0xc000114ed0 0xc000114ee8]   }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task sys: wait for green post-submit: started
    tagx_test.go:601: task mod: read branch head: started
...
    tagx_test.go:601: task mod: tag if appropriate: started
    tagx_test.go:605: task mod: tag if appropriate: done: {mod golang.org/x/mod []  v1.0.0 v1.0.0}
    tagx_test.go:605: task sys: wait for green post-submit: done: ecbcccd5010ff295b9fa481ea074afb948458fce
    tagx_test.go:601: task sys: tag if appropriate: started
    tagx_test.go:623: 2023-09-29 12:37:31.740866 -0700 PDT m=+45.545897929	task sys: tag if appropriate: LOG: Tagging sys at ecbcccd5010ff295b9fa481ea074afb948458fce as v0.2.0
    tagx_test.go:605: task sys: tag if appropriate: done: {sys golang.org/x/sys []  v0.1.0 v0.2.0}
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:623: 2023-09-29 12:38:00.623179 -0700 PDT m=+74.428211368	task tools: generate go.mod: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-2607998828'...
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:469: context deadline exceeded
2023-10-03 21:14 darwin-amd64-12_0 build@821668f7 go@a9036396 x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (65.49s)
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-10-04 18:08:46.374458 -0700 PDT m=+13.986602872	task Select repositories: LOG: Examining repositories [sys mod tools build]
    tagx_test.go:605: task Select repositories: done: [{sys golang.org/x/sys []  v0.1.0 } {mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc000740ed0 0xc000740ee8 0xc000740f00] 1.16 v1.1.5 } {build golang.org/x/build [0xc000740f18 0xc000740f30]   }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task mod: tag if appropriate: started
    tagx_test.go:601: task sys: wait for green post-submit: started
...
    tagx_test.go:601: task mod: tag if appropriate: started
    tagx_test.go:605: task mod: tag if appropriate: done: {mod golang.org/x/mod []  v1.0.0 v1.0.0}
    tagx_test.go:605: task sys: wait for green post-submit: done: 59b99114bb263517b745cbe8b1a35745134ba7b4
    tagx_test.go:601: task sys: tag if appropriate: started
    tagx_test.go:623: 2023-10-04 18:08:59.348955 -0700 PDT m=+26.961100223	task sys: tag if appropriate: LOG: Tagging sys at 59b99114bb263517b745cbe8b1a35745134ba7b4 as v0.2.0
    tagx_test.go:605: task sys: tag if appropriate: done: {sys golang.org/x/sys []  v0.1.0 v0.2.0}
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:623: 2023-10-04 18:09:46.646396 -0700 PDT m=+74.258541211	task tools: generate go.mod: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-382914932'...
    tagx_test.go:601: task tools: generate go.mod: started
    tagx_test.go:469: context deadline exceeded
2023-10-04 18:06 darwin-amd64-12_0 build@4772d0e4 go@e47cab13 x/build/internal/task.TestTagXRepos (log) 
--- FAIL: TestTagXRepos (64.67s)
    tagx_test.go:601: task Create plan: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:601: task Select repositories: started
    tagx_test.go:623: 2023-10-04 11:29:07.030649 -0700 PDT m=+12.667482300	task Select repositories: LOG: Examining repositories [mod tools build sys]
    tagx_test.go:605: task Select repositories: done: [{mod golang.org/x/mod []  v1.0.0 } {tools golang.org/x/tools [0xc0006948e8 0xc000694900 0xc000694918] 1.16 v1.1.5 } {build golang.org/x/build [0xc000694930 0xc000694948]   } {sys golang.org/x/sys []  v0.1.0 }]
    tagx_test.go:601: task Create plan: started
    tagx_test.go:605: task Create plan: done: <nil>
    tagx_test.go:601: task tools: tag if appropriate: started
    tagx_test.go:601: task build: mail go.mod: started
...
    tagx_test.go:601: task tools: wait for green post-submit: started
    tagx_test.go:605: task tools: wait for green post-submit: done: 5738e13e33d872b6a93dc18e72a3262929142cd8
    tagx_test.go:601: task tools: tag if appropriate: started
    tagx_test.go:623: 2023-10-04 11:30:06.009587 -0700 PDT m=+71.646420744	task tools: tag if appropriate: LOG: Tagging tools at 5738e13e33d872b6a93dc18e72a3262929142cd8 as v1.2.0
    tagx_test.go:605: task tools: tag if appropriate: done: {tools golang.org/x/tools [0xc000694630 0xc000694648 0xc000694660] 1.16 v1.1.5 v1.2.0}
    tagx_test.go:601: task build: generate go.mod: started
    tagx_test.go:623: 2023-10-04 11:30:07.052786 -0700 PDT m=+72.689619971	task build: generate go.mod: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-553727786'...
        done.
    tagx_test.go:601: task build: generate go.mod: started
    tagx_test.go:469: context deadline exceeded
2023-10-24 17:53 darwin-amd64-13 build@a966970d go@f9a31cda x/build/internal/task.TestTagSingleRepo (log) 
--- FAIL: TestTagSingleRepo (89.14s)
    --- FAIL: TestTagSingleRepo/with_post-submit_check (82.63s)
        tagx_test.go:600: task Create single-repo plan: started
        tagx_test.go:600: task Load all repositories: started
        tagx_test.go:600: task Load all repositories: started
        tagx_test.go:622: 2023-10-24 14:01:42.887343 -0400 EDT m=+69.593814980	task Load all repositories: LOG: Examining repositories [mod foo]
        tagx_test.go:604: task Load all repositories: done: [{mod golang.org/x/mod []  v1.1.0 } {foo golang.org/x/foo [0xc0005b9128]  v1.1.5 }]
        tagx_test.go:600: task Create single-repo plan: started
        tagx_test.go:604: task Create single-repo plan: done: <nil>
        tagx_test.go:600: task foo: mail go.mod: started
...
            ]
        tagx_test.go:600: task foo: mail go.mod: started
        tagx_test.go:604: task foo: mail go.mod: done: cl_7980548793978b0973e5233cd7a6b23e902b52cb
        tagx_test.go:600: task foo: wait for submit: started
        tagx_test.go:622: 2023-10-24 14:02:33.211424 -0400 EDT m=+119.917896620	task foo: wait for submit: LOG: Awaiting review/submit of (unparseable change ID "cl_7980548793978b0973e5233cd7a6b23e902b52cb")
        tagx_test.go:604: task foo: wait for submit: done: 7980548793978b0973e5233cd7a6b23e902b52cb
        tagx_test.go:600: task foo: wait for green post-submit: started
        tagx_test.go:622: 2023-10-24 14:02:43.317282 -0400 EDT m=+130.023754115	task foo: wait for green post-submit: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr 
        tagx_test.go:600: task foo: wait for green post-submit: started
        tagx_test.go:565: context deadline exceeded
2023-11-19 20:11 darwin-amd64-12_0 build@c3768868 go@06145fe0 x/build/internal/task.TestSyncPrivate (log) 
--- FAIL: TestSyncPrivate (81.19s)
    tagx_test.go:599: task Sync go-private master to public: started
    tagx_test.go:599: task Sync go-private master to public: started
    tagx_test.go:621: 2023-11-19 13:53:48.249599 -0800 PST m=+62.498902576	task Sync go-private master to public: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr Cloning into '/tmp/buildlet/tmp/relui-git-clone-1676881493'...
        done.
    tagx_test.go:599: task Sync go-private master to public: started
    sync_private_test.go:37: context deadline exceeded

— watchflakes

gopherbot avatar Nov 20 '23 20:11 gopherbot

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "darwin" && pkg == "golang.org/x/build/internal/task" && `git command failed: signal: killed`
2023-12-18 17:56 darwin-amd64-13 build@0ce25ffd go@761e10be x/build/internal/task.TestUpdateProxyTestRepo (log) 
--- FAIL: TestUpdateProxyTestRepo (65.28s)
    updateproxytestrepo_test.go:34: git push --tags error: git command failed: signal: killed, stderr

— watchflakes

gopherbot avatar Dec 19 '23 07:12 gopherbot

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "darwin" && pkg == "golang.org/x/build/internal/task" && `git command failed: signal: killed`
2024-03-11 17:58 darwin-amd64-12_0 build@503d6b5b go@63992def x/build/internal/task.TestPrivXPatch (log) 
--- FAIL: TestPrivXPatch (72.68s)
    tagx_test.go:468: task Load all repositories: started
    tagx_test.go:468: task Publish change: started
    tagx_test.go:468: task Create single-repo plan: started
    tagx_test.go:468: task Wait to Announce: started
    tagx_test.go:468: task Mail announcement: started
    tagx_test.go:468: task Load all repositories: started
    tagx_test.go:490: 2024-03-11 11:15:22.131392 -0700 PDT m=+1.015612424	task Load all repositories: LOG: Examining repositories [net]
    tagx_test.go:472: task Load all repositories: done: [{net golang.org/x/net []  v1.0.0 }]
    tagx_test.go:468: task Publish change: started
    tagx_test.go:490: 2024-03-11 11:15:46.94144 -0700 PDT m=+25.825660461	task Publish change: LOG: cloned repo into /tmp/buildlet/tmp/relui-git-clone-2548663649
    tagx_test.go:490: 2024-03-11 11:15:46.94637 -0700 PDT m=+25.830590420	task Publish change: LOG: fetching refs/changes/1234/5 from /tmp/buildlet/tmp/TestPrivXPatch4099315828/001/net
    tagx_test.go:490: 2024-03-11 11:15:52.810919 -0700 PDT m=+31.695138506	task Publish change: LOG: fetched
    tagx_test.go:490: 2024-03-11 11:16:23.239968 -0700 PDT m=+62.124188193	task Publish change: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr 
    tagx_test.go:468: task Publish change: started
    privx_test.go:130: context deadline exceeded

— watchflakes

gopherbot avatar Mar 11 '24 18:03 gopherbot

Found new dashboard test flakes for:

#!watchflakes
post <- goos == "darwin" && pkg == "golang.org/x/build/internal/task" && `git command failed: signal: killed`
2024-03-11 18:47 darwin-amd64-12_0 build@7c2d52f7 go@2ab9218c x/build/internal/task.TestPrivXPatch (log) 
--- FAIL: TestPrivXPatch (65.98s)
    tagx_test.go:468: task Load all repositories: started
    tagx_test.go:468: task Publish change: started
    tagx_test.go:468: task Create single-repo plan: started
    tagx_test.go:468: task Wait to Announce: started
    tagx_test.go:468: task Mail announcement: started
    tagx_test.go:468: task Load all repositories: started
    tagx_test.go:490: 2024-03-11 16:15:06.120952 -0700 PDT m=+1.586512017	task Load all repositories: LOG: Examining repositories [net]
    tagx_test.go:472: task Load all repositories: done: [{net golang.org/x/net []  v1.0.0 }]
    tagx_test.go:468: task Publish change: started
    tagx_test.go:490: 2024-03-11 16:15:37.802435 -0700 PDT m=+33.267994278	task Publish change: LOG: cloned repo into /tmp/buildlet/tmp/relui-git-clone-2771525298
    tagx_test.go:490: 2024-03-11 16:15:37.843506 -0700 PDT m=+33.309065321	task Publish change: LOG: fetching refs/changes/1234/5 from /tmp/buildlet/tmp/TestPrivXPatch2424427232/001/net
    tagx_test.go:490: 2024-03-11 16:15:58.814652 -0700 PDT m=+54.280210881	task Publish change: LOG: fetched
    tagx_test.go:490: 2024-03-11 16:16:06.273555 -0700 PDT m=+61.739113959	task Publish change: LOG: task failed, will retry (1 of 3): git command failed: signal: killed, stderr 
    tagx_test.go:468: task Publish change: started
    privx_test.go:130: context deadline exceeded

— watchflakes

gopherbot avatar Mar 12 '24 19:03 gopherbot

Change https://go.dev/cl/585421 mentions this issue: internal/task: delete constant timeouts to deflake tests

gopherbot avatar May 16 '24 04:05 gopherbot