mars

mars copied to clipboard

**Describe the bug** Mars access some private attribute pof ray which needs to be removed. **To Reproduce** To help us reproducing this bug, please provide information below: 1. Your Python...

chaokunyang

[Ray] Support supervisor on oscar for ray task mode

1

**Is your feature request related to a problem? Please describe.** Currently ray dag mode run supervisor in client, which have some issues: - Client and Ray cluster are usually not...

chaokunyang

**Describe the bug** A clear and concise description of what the bug is. ```python File "/home/admin/mars/mars/core/operand/core.py", line 491, in execute result = executor(results, op) File "/home/admin/mars/mars/dataframe/sort/psrs.py", line 713, in execute...

fyrestone

**Describe the bug** A clear and concise description of what the bug is. ```python mars/deploy/oscar/tests/test_ray_dag.py:189 (test_merge_groupby[before-None]) ray_start_regular_shared2 = RayContext(dashboard_url='', python_version='3.8.13', ray_version='1.13.0', ray_commit='e4ce38d001dbbe09cd21c497fedd03...127.0.0.1:64894', 'address': '127.0.0.1:64894', 'node_id': '987c20539d0bb8031ea7d8ddfc5783c01d5b79d143191bdb072ba21b'}) create_cluster = (, {})...

fyrestone

Ray-based Shuffle For Mars

3

This issue is used for tracking Ray-based Shuffle For Mars progress: - [x] Ray Future-based Shuffle MEP：https://github.com/mars-project/meps/pull/2 - [x] Shuffle Meta optimization #3055 - [x] Ray Future-based Shuffle - [x]...

chaokunyang

[BUG] Ray shuffle reduce call iter_mapper_data_with_index returns incorrect values

1

**Describe the bug** A clear and concise description of what the bug is. ```python mars/dataframe/indexing/tests/test_indexing_execution.py:727 (test_reset_index_execution) setup = def test_reset_index_execution(setup): data = pd.DataFrame( [("bird", 389.0), ("bird", 24.0), ("mammal", 80.5), ("mammal",...

fyrestone

[Proposal] Apply operand closure cleanup

5

For function calls such as DataFrame.apply, DataFrameGroupby.apply, Series.apply, etc., the user will pass in a custom function, i.e. UDF. Mars will serialize the custom function multiple times during graph building,...

chaokunyang

[BUG]Test on ray cluster: TypeError: __init__() missing 1 required positional argument: 'pid'

5

**Describe the bug** When I run the example code in [mars documentation](https://docs.pymars.org/zh_CN/latest/installation/ray.html), I got the error msg my code like this ``` import ray import time import mars import mars.tensor...

guodashun

**Describe the bug** A clear and concise description of what the bug is.  The Mars job executed hundreds of tasks, some task has a large graph:  Set environ...

fyrestone

## What do these changes do? Make subtask submission in batch. ## Related issue number Fixes #3089 ## Check code requirements - [ ] tests added / passed (if needed)...

wjsi