Serapheim Dimitropoulos

Problem seems to stem from here: https://github.com/delphix/appliance-build/blob/a5936cd05378a303b06da8dc59705567382e7205/scripts/upgrade-image-from-aptly-repo.sh#L160 ``` if [[ -n "${DELPHIX_SIGNATURE_TOKEN:-}" ]] && [[ -n "${DELPHIX_SIGNATURE_URL:-}" ]]; then echo "{\"data\": \"$(base64 -w 0 SHA256SUMS)\"}" >sign-request.payload || die "failed to...

http://ops.jenkins.delphix.com/job/devops-gate/job/master/job/appliance-build-stage1/job/post-push/16206/console

``` 06:25:14 + zfs umount rpool/ROOT/****.5nmsMrq/root 06:25:14 umount: /mnt/****.5nmsMrq: target is busy. 06:25:14 cannot unmount '/mnt/****.5nmsMrq': umount failed 06:25:14 E: config/hooks/90-raw-disk-image.binary failed (exit non-zero). You should check for errors. 06:25:14...

http://ops.jenkins.delphix.com/job/devops-gate/job/master/job/appliance-build-stage1/job/post-push/126760/execution/node/84/log/ ``` 23:25:14 + zfs umount rpool/ROOT/delphix.6gFJcvK/root 23:25:14 umount: /mnt/delphix.6gFJcvK: target is busy. 23:25:14 cannot unmount '/mnt/delphix.6gFJcvK': umount failed 23:25:14 E: config/hooks/90-raw-disk-image.binary failed (exit non-zero). You should check for errors....

Disregard the content below see Pavel's comment ======= Hit again: http://ops.jenkins.delphix.com/job/devops-gate/job/master/job/appliance-build-stage1/job/post-push/16206/console ``` 06:25:05 + for dir in /dev /proc /sys 06:25:05 + umount -R /mnt/****.CqlknvK/sys 06:25:05 + umount /mnt/****.CqlknvK/var/log 06:25:05...

``` 03:21:13 + curl -s -S -f -H 'Content-Type: application/json' -u **** ****/upgrade/keyVersion/5.3/sign -d @hashes64.payload 03:21:13 curl: (22) The requested URL returned error: 500 03:21:13 E: config/hooks/90-linux-migration-artifact.binary failed (exit non-zero)....

Another hit: http://ops.jenkins.delphix.com/job/devops-gate/job/master/job/appliance-build-stage1/job/post-push/126915/execution/node/69/log/?consoleFull

`whatis` was added here -> https://github.com/delphix/sdb/pull/267 An add-on for the above PR would be to make `whatis` work with spl-backed caches.

This should not be hard to do as `drgn` provides such a helper: https://drgn.readthedocs.io/en/latest/helpers.html#drgn.helpers.linux.mm.cmdline

I think having `ps` is a good idea for people that don't know about `threads` to start from somewhere - it could even be a layer build on top `threads`...