ocaml-ci icon indicating copy to clipboard operation
ocaml-ci copied to clipboard

macos runner seems to fail

Open hannesm opened this issue 1 year ago • 6 comments

Context

Take a look into https://ocaml.ci.dev/github/mirage/mirage-net/commit/8cfd7946c6f3baf7ec2722d412da9be9ddc2ef10/variant/macos-homebrew-5.2_arm64_opam-2.2 (part of https://github.com/mirage/mirage-net/pull/25)

Here, there's a spurious failure

Step(s) to reproduce

Unclear what is needed for reproduction. It is unclear to me what is exactly happening, since other macOS runners are working nicely - even in the same PR.

Expected behaviour

The build should succeed

Technical details

Done.
# Run eval $(opam env) to update the current shell environment
2024-10-01 09:44.12 ---> using "9140a4d29739976f645a65eade89cc9e307554b1ce6226104c32cda5563a0f6c" from cache


/: (copy (src .) (dst ./src))
2024-10-01 09:44.13 ---> saved as "28d1f27bf80c439f8cee08cf3a1257af233f56bd0c0362f0f06a7ffccef56e37"


/: (run (shell "cd ./src && opam exec -- dune build @install @check @runtest && rm -rf _build"))
2024-10-01 09:44.14 ---> saved as "56b01c443d7147fc1327834868915a41cda990117d1a5e5318e1733b91a75e8a"
Uncaught exception: Failure("\"zfs\" \"unmount\" \"obuilder/result\" failed with exit status 1")
2024-10-01 09:44.16: Job failed: Failed: Internal error

hannesm avatar Oct 01 '24 09:10 hannesm

Rebuilding fixed it in this case. I'll dig deeper to see if I can get to the bottom of why this happens.

mtelvers avatar Oct 01 '24 09:10 mtelvers

Thanks @mtelvers.

hannesm avatar Oct 01 '24 10:10 hannesm

not sure if this is related, but I just got another strange macos error:

2024-10-01 13:17.54: Got resource from pool OCluster
Building on m1-worker-03
error: RPC failed; curl 92 HTTP/2 stream 5 was not closed cleanly: CANCEL (err 8)
error: 2623 bytes of body are still expected
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: fetch-pack: invalid index-pack output
git-fetch failed with exit-code 128
2024-10-01 13:19.01: Job failed: Failed: Build failed

https://github.com/mirage/mirage/pull/1566/checks?check_run_id=30915488979

hannesm avatar Oct 01 '24 13:10 hannesm

https://github.com/ocurrent/obuilder/pull/192 should address the original issue.

The other issue relates to the http transport used by git on macOS. See stackoverflow.com. To test, I've set the http version and superficially this has cleared the error.

git config --global http.version HTTP/1.1

mtelvers avatar Oct 01 '24 17:10 mtelvers

Hey,

I just encountered:

2024-10-21 13:50.42 ---> saved as "4305ba89692ef85cf74fb06224cbd3cf4bea5f319c8fac778fc0813c2d94bc68"
Uncaught exception: Failure("\"zfs\" \"unmount\" \"obuilder/result\" failed with exit status 1")
2024-10-21 13:50.44: Job failed: Failed: Internal error

again on https://ocaml.ci.dev/github/robur-coop/albatross/commit/d9bb7eab6888ac40e8eb97e81274e0c560e6d2df/variant/macos-homebrew-4.14_arm64_opam-2.2

Not sure what the underlying issue is, it sounded like you fixed it!?

Thanks a lot for providing the CI service.

hannesm avatar Oct 21 '24 14:10 hannesm

Thank you for the report. We have been observing some ongoing instability in macos workers and it is under investigation.

shonfeder avatar Oct 22 '24 14:10 shonfeder