mars icon indicating copy to clipboard operation
mars copied to clipboard

[ray] Support scheduling ray tasks in Ray oscar deploy backend

Open chaokunyang opened this issue 3 years ago • 2 comments

What do these changes do?

This PR add support for scheduling ray tasks in Ray oscar deploy backend

Related issue number

Closes #3164

Check code requirements

  • [ ] tests added / passed (if needed)
  • [ ] Ensure all linting tests pass, see here for how to run them

chaokunyang avatar Jun 23 '22 10:06 chaokunyang

Why not create an actor of Mars LocalCluster of mars/deploy/oscar/local.py? This is much simpler and most of the logic is shared with Mars which is well tested in CI.

fyrestone avatar Jun 24 '22 02:06 fyrestone

Why not create an actor of Mars LocalCluster of mars/deploy/oscar/local.py? This is much simpler and most of the logic is shared with Mars which is well tested in CI.

Creating supervisor in Ray oscar can reuse all existing integration with ray. If we create an actor of Mars LocalCluster of mars/deploy/oscar/local.py, the serialization and communication between mars client and supervisor will be an issue:

  • We need to implement a proxy for LocalCluster based on ray call
  • ObjectRef can't be passed to supervisor from mars client directly

chaokunyang avatar Jun 27 '22 07:06 chaokunyang