Rahul Naskar

Fix/use intstr intorstring

1

## What this PR does This PR adds full support for using `intstr.IntOrString` for `spec.driver.cores` and `spec.executor.cores` in `SparkApplication`. This allows users to specify CPU cores as either: - Integers...

docs(helm): document default Spark UI ingress TLS and annotations

1

This PR documents the default Spark UI ingress TLS and annotations feature introduced in PR #2513. Fixed issue: #2558 It adds: - An explanation of Helm-level default TLS and annotation...

Fix: Sync Volcano PodGroup Queue & Priority on Update

1

### Summary This PR fixes an issue #2526 in the Volcano batch scheduler integration where an existing PodGroup only updated `minMember` during re-sync but did not update: - spec.queue -...

feat: add gRPC Spark submitter plugin + proto (optional plugin for spark-submit via gRPC)

1

## Summary This PR adds a configurable gRPC plugin for submitting Spark applications (instead of invoking `${SPARK_HOME}/bin/spark-submit`). Submitting via gRPC reduces per-submission overhead (no new process per submission) and enables...

feat(scheduledsparkapplication): configurable timestampPrecision (nan…

6

feat(scheduledsparkapplication): add configurable timestampPrecision for run name generation This PR introduces a new field `.spec.timestampPrecision` that allows users to control the precision of the timestamp suffix added to `SparkApplication` names...

Feat/sparkconnect ingress

3

Summary This PR introduces first-class Ingress support for SparkConnect by extending the CRD, controller logic, and Helm chart. This enables users to expose Spark Connect Server externally (HTTP/TCP ingress) in...

chore(backend): add TLS certificate rotation documentation and helper scripts. Fixes #12328

3

chore(backend): add TLS certificate rotation documentation and helper scripts. Fixes #12328 **Description of your changes:** This PR adds missing documentation for TLS certificate rotation required when using the pod-to-pod TLS...

feat(launcher): Add configurable CA bundle environment variables to launcher v2

2

### What this PR does / why we need it This PR introduces support for configuring which CA-related environment variables the v2 launcher sets when a user provides a custom...