mars
mars copied to clipboard
[ray] Support scheduling ray tasks in Ray oscar deploy backend
What do these changes do?
This PR add support for scheduling ray tasks in Ray oscar deploy backend
Related issue number
Closes #3164
Check code requirements
- [ ] tests added / passed (if needed)
- [ ] Ensure all linting tests pass, see here for how to run them
Why not create an actor of Mars LocalCluster of mars/deploy/oscar/local.py? This is much simpler and most of the logic is shared with Mars which is well tested in CI.
Why not create an actor of Mars
LocalClusterofmars/deploy/oscar/local.py? This is much simpler and most of the logic is shared with Mars which is well tested in CI.
Creating supervisor in Ray oscar can reuse all existing integration with ray. If we create an actor of Mars LocalCluster of mars/deploy/oscar/local.py, the serialization and communication between mars client and supervisor will be an issue:
- We need to implement a proxy for LocalCluster based on ray call
- ObjectRef can't be passed to supervisor from mars client directly