spark-operator icon indicating copy to clipboard operation
spark-operator copied to clipboard

Spark executor failing with a weird error

Open ben5556 opened this issue 2 years ago • 3 comments

We are noticing intermittent issues where spark driver and executor pods are failing. We are observing the below error in spark operator logs

I1221 05:43:21.925839 9 event.go:282] Event(v1.ObjectReference{Kind:"SparkApplication", Namespace:"spark-operator", Name:"spark-stream", UID:"704c4b19-d6e8-4e6f-970d-d0ad5d1f9ed4", APIVersion:"sparkoperator.k8s.io/v1beta2", ResourceVersion:"1166660949", FieldPath:""}): type: 'Warning' reason: 'SparkExecutorFailed' Executor [spark-stream-3394cd8533264232-exec-3 %!s(int32=1) Error] failed with ExitCode: %!d(MISSING), Reason: %!s(MISSING)

ben5556 avatar Dec 21 '22 05:12 ben5556

Does anybody know something about this strange message?

PavloChechehov avatar May 01 '24 17:05 PavloChechehov

I also get the same error on some tasks. I have not found a solution yet

Neerols avatar May 20 '24 14:05 Neerols

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

github-actions[bot] avatar Aug 18 '24 16:08 github-actions[bot]

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.

github-actions[bot] avatar Sep 07 '24 18:09 github-actions[bot]