spark-operator
spark-operator copied to clipboard
PR_SET_CHILD_SUBREAPER is unavailable on this platform
I have a local k3s Kubernetes created by Rancher Desktop on MacBook Pro with M1 chip.
I try to install spark-on-k8s-operator by
helm repo add spark-operator https://googlecloudplatform.github.io/spark-on-k8s-operator
helm install spark spark-operator/spark-operator --namespace spark-operator --create-namespace
However, I got the error for the pod spark-spark-operator-6964986646-5vctk
:
++ id -u
+ myuid=0
++ id -g
+ mygid=0
+ set +e
++ getent passwd 0
+ uidentry=root:x:0:0:root:/root:/bin/bash
+ set -e
+ echo 0
+ echo 0
+ echo root:x:0:0:root:/root:/bin/bash
0
0
root:x:0:0:root:/root:/bin/bash
+ [[ -z root:x:0:0:root:/root:/bin/bash ]]
+ exec /usr/bin/tini -s -- /usr/bin/spark-operator -v=2 -logtostderr -namespace= -enable-ui-service=true -ingress-url-format= -controller-threads=10 -resync-interval=30 -enable-batch-scheduler=false -label-selector-filter= -enable-metrics=true -metrics-labels=app_type -metrics-port=10254 -metrics-endpoint=/metrics -metrics-prefix= -enable-resource-quota-enforcement=false
[FATAL tini (1)] PR_SET_CHILD_SUBREAPER is unavailable on this platform. Are you using Linux >= 3.4?
Any idea? Thanks! 😃
I'm having the same issue on colima
This comment explains the root cause of the issue: https://github.com/docker/for-mac/issues/6620#issuecomment-1694380189
It seems that this is triggered by the Spark container image using tini -s
in the entrypoint.sh
script, e.g. for 3.5.0:
https://github.com/apache/spark-docker/blob/master/3.5.0/scala2.12-java11-ubuntu/entrypoint.sh
How can we solve this and get the setup in local. It is failing with latest rancher desktop
If you use colima
with rosetta emulation or with an amd profile, it should resolve. I previously had this error. See details at Rosetta 2 emulation
#AMD profile
colima start --profile amd --arch amd --cpu 4 --memory 8 --disk 80
# or rosetta emulation
colima start --arch aarch64 --vm-type=vz --vz-rosetta --cpu 4 --memory 8 --disk 80
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.