Thomas Leonard

The scheduler only reports details of queued jobs, not running ones. All four machines here are running a job, but two have another job queued up after that. (and yes,...

Is there anything in the logs about it? e.g. `journalctl -u ocluster-worker --since 2021-03-07`

It's possible that it's this mutex, which I added to prevent running btrfs operations concurrently: https://github.com/ocurrent/obuilder/blob/b38e96b12ef6f44ae8b415daaa35773c5723ba5e/lib/btrfs_store.ml#L28 Might be worth removing that to see if it's OK now.

Interesting! And it looks like the cancel really did come just as it was ending by itself: ``` 2021-04-20 15:49.39 ---> saved as "b0b283f02043e3151860b54a8b59833c5b3904c2a7ca4fdb8851ef881f9f2749" 2021-04-20 15:49.53: Cancelling: Timeout (60.0 minutes)...

If you're going to add that, it might be better to use the new let syntax instead, e.g. ```ocaml let average ar = let sum = merge ar ~f:(+.) in...

Very odd. According to the logs, this has happened a few times, e.g. ``` x86-bm-10.ocamllabs.io : ./2021-05-18/115511-ci-ocluster-build-397cc5.log:time="2021-05-18T12:41:08Z" level=error msg="container_linux.go:370: starting container process caused: process_linux.go:459: container init caused: rootfs_linux.go:59: mounting \"/etc/resolv.conf\"...

In ocaml-ci, we perform downloading and testing in separate steps so this shouldn't be a problem (only the download step uses `(network host)`). Tests should be able to run without...

> Are there any blockers apart from applying the suggestions from the code review and rebasing? I'd definitely enjoy debugging with backtraces (hoping that the switch to OCaml 5 and...

The logs show: ``` Jun 15 22:14:06 sd-148465 ocluster-worker[2964049]: 2021-06-15 22:14.06 obuilder [INFO] Pruning 100 items (of 100 requested) Jun 15 22:14:06 sd-148465 ocluster-worker[2964049]: 2021-06-15 22:14.06 application [INFO] Exec "btrfs"...

I think the problem here is that the Dockerfile format just doesn't support this (see https://stackoverflow.com/questions/33439230/how-to-write-commands-with-multiple-lines-in-dockerfile-while-preserving-the-new). Perhaps we should just reject attempts to convert to Dockerfile format in this case?