volcano
volcano copied to clipboard
volcano-sh
Volcano job natively support Ray framework
What is the problem you're trying to solve
Ray is a popular AI framework that has been widely used, and ray operator has already supported Volcano as a batch scheduler, see：https://github.com/ray-project/kuberay On the other hand, many users still use volcano job to run their job instead of new ray API，so it's reasonable to support ray natively on volcano job.
Describe the solution you'd like
Currently volcano supports distributed AI and HPC framework like pytorch, tensorflow, mpi.
Just like what vcjobs currently do, and a new plugin named ray in pkg/controllers/job/plugins/distributed-framework, so users can submit a vcjob and actually run a ray job.
Additional context
@Monokaix: This request has been marked as suitable for new contributors.
Please ensure the request meets the requirements listed here.
If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-good-first-issue command.
In response to this:
/good-first-issue
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.
@MondayCha: GitHub didn't allow me to assign the following users: me.
Note that only volcano-sh members, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time. For more information please see the contributor guide
In response to this:
/assign me
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.
/assign
Sorry, this issue has been assigned to @MondayCha and you can find other issues that need to be resolved: )
@de6p Excuse me, Could you consider using my code for ray plugin? For #4581 , the code, architecture, docs, user-guide and tests(UT & E2E) have been prepared.
