spark-operator icon indicating copy to clipboard operation
spark-operator copied to clipboard

Add support for suspend

Open ChenYi015 opened this issue 1 year ago • 7 comments

What feature you would like to be added?

  • Add a new field .spec.suspend to the SparkApplication CRD.
  • The controller will not submit the SparkApplication except for the .spec.suspend is false.

Why is this needed?

No response

Describe the solution you would like

No response

Describe alternatives you have considered

No response

Additional context

No response

Love this feature?

Give it a 👍 We prioritize the features with most 👍

ChenYi015 avatar Oct 28 '24 09:10 ChenYi015

/assign

vector-flow avatar Dec 11 '24 21:12 vector-flow

@tariq-hasan - curious if you still plan to implement this for Spark Operator? We are looking into using Kueue for Spark Applications and this feature is a prerequisite.

munali avatar Jan 14 '25 19:01 munali

@tariq-hasan I also need to integrate SparkApplication into Kueue. As @munali wrote, suspend/resume feature would enable seamless integration with Kueue.

Would you mind me taking over this issue from you? Actually my PR(#2387) has been already pushed. I'm really appreciated if you gave a review to my PR, too.

Moreover, I'm working on Kueue integraiton on my personal branch: https://github.com/everpeace/kueue/tree/kubeflow-spark-operator

everpeace avatar Jan 17 '25 18:01 everpeace

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

github-actions[bot] avatar Apr 21 '25 04:04 github-actions[bot]

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.

github-actions[bot] avatar May 11 '25 04:05 github-actions[bot]

/reopen

everpeace avatar May 11 '25 05:05 everpeace

@everpeace: Reopened this issue.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

google-oss-prow[bot] avatar May 11 '25 05:05 google-oss-prow[bot]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

github-actions[bot] avatar Aug 09 '25 06:08 github-actions[bot]

/lifecycle frozen

ChenYi015 avatar Aug 11 '25 03:08 ChenYi015