Ryuk.Kim
Ryuk.Kim
@Zhang-Aoqi Same Issue here. and i figured it out finally! that error does not come from your spark app. it's happend with your spark-operator pod. In my case, my spark...
@Zhang-Aoqi Good to know! Thanx. So Did you change your spark version?
@Zhang-Aoqi Alright! if this error happens again, then try this image to build spark-operator `gcr.io/spark-operator/spark:v3.1.1-hadoop3` kind of simmilar issue here : [https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/issues/1334](https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/issues/1334)
@farshadsm just access to your spark-operator pod and run following command :) `ls /opt/spark/jars | grep hadoop`