mars
mars copied to clipboard
mars-project
Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
This PR adds a univeral function `replace_subgraph` to `OptimizationRule` for later use. The unit test cases are added as well. Fixes #3352 ## Check code requirements - [x] tests added...
**Describe the bug** Series with multi index accessing data by index error, but pandas works well. **To Reproduce** ```python import pandas as pd arrays = [["m1", "m2", "m3"], ["n1", "n2",...
The `Series` doesn't support attribute access, but the [pandas'](https://pandas.pydata.org/pandas-docs/version/1.5/user_guide/indexing.html#attribute-access) can. **To Reproduce** ``` import mars.dataframe as md s1 = md.Series([1, 2, 3], index=list("abc")) print(s1.b) >>> AttributeError: 'SeriesData' object has no...
Currently in OptimizationRule, there're only collapsable_predecessors adding/removing and node replacing functions to handle graph mutation. However, some new rules may need to replace a piece of subgraph by adding/removing nodes...
## What do these changes do? In `gen_subtask_graph`, Mars always create new out chunks even if the out chunk already exists. It costs a lot of time if there are...
## Problem In `gen_subtask_graph`, Mars always create new out chunks even if the out chunk already exists. It costs a lot of time if there are plenty of chunks. Actually,...
## What do these changes do? ## Related issue number Fixes #xxxx ## Check code requirements - [ ] tests added / passed (if needed) - [ ] Ensure all...
Bumps [webpack](https://github.com/webpack/webpack) from 5.42.0 to 5.76.0. Release notes Sourced from webpack's releases. v5.76.0 Bugfixes Avoid cross-realm object access by @Jack-Works in webpack/webpack#16500 Improve hash performance via conditional initialization by @lvivski...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
## Problem Currently, the supervisor will cancel the execution of the entire stage after receiving an error report that the execution of the subtask fails when the MainPool process exits...
## What do these changes do? Currently, the supervisor will cancel the execution of the entire stage after receiving an error report that the execution of the subtask fails when...
Metadata
Owner
Metadata
Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.