spark-operator icon indicating copy to clipboard operation
spark-operator copied to clipboard

PR_SET_CHILD_SUBREAPER is unavailable on this platform

Open hongbo-miao opened this issue 1 year ago • 5 comments

I have a local k3s Kubernetes created by Rancher Desktop on MacBook Pro with M1 chip.

I try to install spark-on-k8s-operator by

helm repo add spark-operator https://googlecloudplatform.github.io/spark-on-k8s-operator
helm install spark spark-operator/spark-operator --namespace spark-operator --create-namespace

However, I got the error for the pod spark-spark-operator-6964986646-5vctk:

++ id -u
+ myuid=0
++ id -g
+ mygid=0
+ set +e
++ getent passwd 0
+ uidentry=root:x:0:0:root:/root:/bin/bash
+ set -e
+ echo 0
+ echo 0
+ echo root:x:0:0:root:/root:/bin/bash
0
0
root:x:0:0:root:/root:/bin/bash
+ [[ -z root:x:0:0:root:/root:/bin/bash ]]
+ exec /usr/bin/tini -s -- /usr/bin/spark-operator -v=2 -logtostderr -namespace= -enable-ui-service=true -ingress-url-format= -controller-threads=10 -resync-interval=30 -enable-batch-scheduler=false -label-selector-filter= -enable-metrics=true -metrics-labels=app_type -metrics-port=10254 -metrics-endpoint=/metrics -metrics-prefix= -enable-resource-quota-enforcement=false
[FATAL tini (1)] PR_SET_CHILD_SUBREAPER is unavailable on this platform. Are you using Linux >= 3.4?

Any idea? Thanks! 😃

hongbo-miao avatar Apr 24 '23 19:04 hongbo-miao

I'm having the same issue on colima

sshahar1 avatar Jul 21 '23 15:07 sshahar1

This comment explains the root cause of the issue: https://github.com/docker/for-mac/issues/6620#issuecomment-1694380189

It seems that this is triggered by the Spark container image using tini -s in the entrypoint.sh script, e.g. for 3.5.0: https://github.com/apache/spark-docker/blob/master/3.5.0/scala2.12-java11-ubuntu/entrypoint.sh

nielspardon avatar Oct 10 '23 11:10 nielspardon

How can we solve this and get the setup in local. It is failing with latest rancher desktop

sutodi avatar Apr 04 '24 13:04 sutodi

If you use colima with rosetta emulation or with an amd profile, it should resolve. I previously had this error. See details at Rosetta 2 emulation

#AMD profile
colima start --profile amd --arch amd --cpu 4 --memory 8 --disk 80

# or rosetta emulation
colima start --arch aarch64 --vm-type=vz --vz-rosetta --cpu 4 --memory 8 --disk 80

flowy0 avatar Apr 05 '24 00:04 flowy0

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

github-actions[bot] avatar Aug 14 '24 06:08 github-actions[bot]