Kerberos configuration support

[sagarprst]

What question do you want to ask?

Does spark operator support Kerberos authentication ?

Additional context

We're running secure Spark workloads within a Kerberos-enabled Hadoop ecosystem (Hive Metastore, HDFS, etc.) using the Spark Operator. While configuring Kerberos authentication, we’ve encountered consistent and blocking issues that appear to be coming from missing support in the SparkApplication CRD.

What I've Tried so far :

1. Mounted krb5.conf via configMap

2. Mounted keytab file via k8s secret

3. Set relevant sparkConf entries

Bit it's failing

Have the same question?

Give it a 👍 We prioritize the question with most 👍

[sundasu]

Any update on this? I'm trying to implement the Same Architecture Kerberos Auth with Spark Operator, not working at all.

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[ChenYi015]

/lifecycle frozen

[josecsotomorales]

We could look at PRs previously submitted and support Kerberos auth; other operators are currently supporting it:

Add kerberos changes for secure hadoop access

Add kerberos support for spark applications to interact with secure h…

@ChenYi015, happy to work on a PR. What are your thoughts on this?

[ChenYi015]

@josecsotomorales Adding support for Kerberos configuration is a great feature. Any contributions are welcome!

[josecsotomorales]

Here we go! PR ready for review: https://github.com/kubeflow/spark-operator/pull/2630